This site is an expanded and significantly upgraded version of the Flickr Commons based tool I created several years ago. As well as a major design/UX overhaul, it now includes data from further providers (see full list below). I'd welcome further suggestions as the harvesting tool and database are easily extendable.
For information, questions and bug reports please contact James Morley @jamesinealing | james@jamesmorley.net
Current totals by data source
Current totals by date accuracy
Breakdown of institutional data retrieved through Europeana
Het Nationaal Glasmuseum - 22336 items; Sjöhistoriska museet - 11809 items; Bohusläns museum - 7936 items; Vänersborgs museum - 7561 items; Kulturarv Västernorrland - 4090 items; Rijksmuseum - 3241 items; Tekniska museet - 2444 items; Armémuseum, Stockholm, Sweden - 2317 items; Karlsborgs fästningsmuseum - 2007 items; Miliseum - 1287 items; Örebro läns museum - 1254 items; Flygvapenmuseum - 1058 items; ModeMuseum Provincie Antwerpen - 1042 items; Marinmuseum - 735 items; Skansen - 629 items; Österreichische Nationalbibliothek - Austrian National Library - 579 items; Riksantikvarieämbetet - 381 items; Stiftelsen Nordiska museet - 288 items; Historisch Museum Ede - 254 items; Stedelijk Museum Zutphen - 221 items; Ajuntament de Girona - 106 items; CODA Museum - 103 items; INP - National Heritage Institute, Bucharest - 103 items; Upplandsmuseet - 102 items; The Archaeological Heritage Agency of Iceland - 95 items; Aaltense Musea - 58 items; Stadsmuseum Harderwijk - 56 items; Sundsvalls museum - 50 items; National library of Montenegro "Đurđe Crnojević" - 44 items; Länsmuseet Gävleborg - 37 items; Nederlands Openluchtmuseum - 31 items; Vasamuseet - 28 items; Images of Old Cluj - 27 items; Nederlands Tegelmuseum - 20 items; Postmuseum - 18 items; Δήμος Τρίπολης - 11 items; Botanic Garden and Botanical Museum Berlin-Dahlem - 9 items; Cluj County Library - 9 items; Slovak National Library - 8 items; Csorba Győző Könyvtár - Pécs - 7 items; Stadskasteel Zaltbommel - 7 items; Stichting Liemers Museum - 6 items; Lietuvos dailės muziejus - 4 items; Žemaičių muziejus „Alka“ / Samogitian Museum "Alka" - 3 items; Deventer Musea - 3 items; NOC*NSF - 3 items; Nationalmuseum, Sweden - 2 items; Wikimedia Commons Community - 2 items; Lietuvos švietimo istorijos muziejus / Museum of Lithuanian Education History - 2 items; Rippl-Rónai Megyei Hatókörű Városi Múzeum - Kaposvár - 2 items; Museum Elburg - 1 items; National Library of Bulgaria - 1 items; Horniman Museum and Gardens - 1 items; jNederlands Openluchtmuseum - 1 items; Lietuvos dailės muziejus / Lithuanian Art Museum - 1 items; Kauno IX forto muziejus / Kaunas 9th Fort Museum - 1 items; A. Baranausko ir A. Vienuolio-Žukausko memorialinis muziejus / Antanas Baranauskas and Antanas Vienuolis-Žukauskas Memorial Museum - 1 items; Slot Loevestein - 1 items; Museon - 1 items
Breakdown of institutional data retrieved through Flickr Commons
The U.S. National Archives - 1730 items; The Library of Congress - 1093 items; SMU Libraries Digital Collections - 1038 items; State Library and Archives of Florida - 912 items; State Library of Queensland, Australia - 891 items; Cornell University Library - 840 items; bibliothequedetoulouse - 821 items; Australian National Maritime Museum on The Commons - 567 items; Swedish National Heritage Board - 559 items; National Library of Ireland on The Commons - 494 items; State Library of New South Wales collection - 402 items; Vestfoldmuseene | Vestfold Museums - 385 items; MissouriStateArchives - 371 items; National Library of Australia Commons - 295 items; NASA on The Commons - 262 items; Tyne & Wear Archives & Museums - 249 items; National Library of Norway - 229 items; Royal Australian Historical Society - 216 items; Deseronto Archives - 183 items; Provincial Archives of Alberta - 177 items; Powerhouse Museum Collection - 170 items; UW Digital Collections - 123 items; National Library NZ on The Commons - 123 items; UA Archives | Upper Arlington History - 114 items; National Library of Scotland - 105 items; Jewish Historical Society of the Upper Midwest - 89 items; Australian War Memorial collection - 88 items; Tasmanian Archive and Heritage Office Commons - 78 items; National Archives of Estonia - 67 items; Museum of Photographic Arts Collections - 64 items; Stockholm Transport Museum Commons - 61 items; Liberas / Liberaal Archief - 59 items; National Museum of Denmark - 55 items; Costică Acsinte Archive - 49 items; The Gallen-Kallela Museum - 46 items; Archives of the Finnish Broadcasting Company Yle - 46 items; Museum of Hartlepool - 45 items; George Eastman Museum - 33 items; San Diego Air & Space Museum Archives - 32 items; The National Archives UK - 31 items; tyrrellhistoricallibrary - 29 items; Preus museum - 27 items; Fylkesarkivet i Sogn og Fjordane - 21 items; OSU Special Collections & Archives : Commons - 21 items; The Finnish Museum of Photography - 20 items; National Science and Media Museum - 17 items; Schlesinger Library, RIAS, Harvard University - 9 items; Huron County Museum & Historic Gaol - 7 items; Smithsonian Institution - 4 items; Getty Research Institute - 4 items; Svenska litteratursällskapet i Finland - 4 items; The British Library - 2 items; Camden Public Library (Maine) - 2 items; Center for Jewish History, NYC - 1 items; Kalamazoo Public Library - 1 items; Aalto University Library and Archive Commons - 1 items;
The data has been harvested from providers using some custom php scripts to query respective APIs based on dates. Data is harmonised and stored in a local mySql database.
Additional jQuery plugins are used to enhance the display, including Masonry and Bootstrap Image Gallery (based on blueimp).
The website code and generated data is openly licensed so please feel free to copy, modify, distribute as you please (subject to any restrictions as imposed by the content and toolset providers).
Private Charles Christopher Pannell 534325, 15th Battalion London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Charles Ford 533724, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Charles H Watts 52896. Unit: 14th Platoon, D Company, Royal Fusiliers. Death: 30 November 1917 Missing in Action Western Front
Died 30 November 1917
Imperial War Museum
Private Charles William Thom 530546, London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Colin W. Hackney 43544. Unit: Medical Orderly, Aid Post, Suffolk Regiment. Death: 30 November 1917, missing in action, Western Front.
Died 30 November 1917
Imperial War Museum
Private Cyril James Wilson 535289, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Cyril John Powell 535008, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private David Evans 534577, 15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private David Mullings 10358, British West Indies Regiment
Died 30 November 1917
Lives of the First World War
Private Edward Ernest Holder 841194, 1/6th Bn London Regiment (City of London Rifles)
Died 30 November 1917
Lives of the First World War
Private Edward Gallon 536605, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Edward Henry Gittins 39760, South Wales Borderers
Died 30 November 1917
Lives of the First World War
Private Edward Joseph Vernon 535121, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Edwin Donald Miller 355817, The King's (Liverpool) Regiment
Died 30 November 1917
Lives of the First World War
Private Ernest Lambert Hayhurst 49755. Unit: "D" Company, 8th Battalion, Royal Fusiliers. Death: 30 November 1917, missing in action, Western Front. Commemorated on the Cambrai Memorial.
Died 30 November 1917
Imperial War Museum
Private Ernest William Holdway 533070, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Frank Emsley 33846, King's Own (Royal Lancaster Regiment)
Died 30 November 1917
Lives of the First World War
Private Frederick Bruce Olding 535323, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Frederick George Dancox VC 21654, Worcestershire Regiment
Died 30 November 1917
Lives of the First World War
Private Frederick John Beddis 533443, 15th London Regiment
Died 30 November 1917
Lives of the First World War
Private Frederick John House 27656, Somerset Light Infantry
Died 30 November 1917
Lives of the First World War
Private Frederick Thomas Wadsworth 532114, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Frederick Walter Yarwood S/25392, Rifle Brigade
Died 30 November 1917
Lives of the First World War
Private George Armstrong Pearson 143793. Unit: 110th Siege Battery, Royal Garrison Artillery. Death: 30 November 1917 Missing Western Front
Died 30 November 1917
Imperial War Museum
Private George Gates Carroll 534261, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Gilbert Henry Buckley 241688, King's Own Scottish Borderers
Died 30 November 1917
Lives of the First World War
Private Harold Thomas Price 536947, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Harry Cecil Hammond 62221. Unit: 2nd Lewis Gun Section, 13th Platoon, "D" Company, 8th Battalion, Royal Fusiliers. Death: 30 November 1917, missing in action, Western Front. Commemorated on the Cambrai Memorial.
Died 30 November 1917
Imperial War Museum
Private Harry Walmsley 56746, Machine Gun Corps (Cavalry)
Died 30 November 1917
Lives of the First World War
Private Henry George Lilley 537093, London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Herbert Allen Mobbs 20335. Unit: 9th Platoon, C Company, 13th Battalion, Essex Regiment. Death: 30 November 1917 Missing At Cambrai Western Front
Died 30 November 1917
Imperial War Museum
Private James Lambert Brown G/19322, Middlesex Regiment
Died 30 November 1917
Lives of the First World War
Private John Clark 11890. Unit: 12th Platoon, C Company, 1st Battalion, King's Own Scottish Borderers. Death: 30 November 1917 Missing in action believed wounded Western Front
Died 30 November 1917
Imperial War Museum
Private John Francis Baskerville 19398, Coldstream Guards
Died 30 November 1917
Lives of the First World War
Private John Gordon 535304, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private John Greener 535303, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private John Isaac Williams 2021, King's Shropshire Light Infantry
Died 30 November 1917
Lives of the First World War
Private Joseph Bernard Ryan G/18968. Unit: 6th Battalion, The Buffs (East Kent Regiment). Death: 30 November 1917 Missing at Cambrai Western Front
Died 30 November 1917
Imperial War Museum
Private Leonard Charles TARVER 531857, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Matthew Fitzpatrick R/39670, King's Royal Rifle Corps
Died 30 November 1917
Lives of the First World War
Private Owen Bateman 535283, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Percy Lines 531591, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Ralph Thomas 34094, The King's (Shropshire Light Infantry)
Died 30 November 1917
Lives of the First World War
Private Reginald Stanley Sherring 800458, London Regiment (Royal Fusiliers)
Died 30 November 1917
Lives of the First World War
Private Ronald Percy Cooper 11091, Duke of Cornwall's Light Infantry
Died 30 November 1917
Lives of the First World War
Private Sidney Charles Pearce 536614, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Sidney Frank Uphill 265522, Somerset Light Infantry
Died 30 November 1917
Lives of the First World War
Private Sidney Frank Uphill 265522. Unit: B Company, 7th Battalion, Somerset Light Infantry. Death: 30 November 1917 Missing at Cambrai Western Front
Died 30 November 1917
Imperial War Museum
Private Stanley Chapman 265698, The King's (Liverpool Regiment)
Died 30 November 1917
Lives of the First World War
Private Stanley Howard Stevens 536734, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Stanley Thomas Knight 531997, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Sydney Ephraim Rampley 13624, Suffolk Regiment
Died 30 November 1917
Lives of the First World War
Private Thomas Albert Pennington 40177, South Lancashire Regiment
Died 30 November 1917
Lives of the First World War
Private Thomas Rose 33597, King's Own (Royal Lancaster Regiment)
Died 30 November 1917
Lives of the First World War
Private Thomas Turnbull 202648, The Loyal North Lancashire Regiment
Died 30 November 1917
Lives of the First World War
Private Victor Frank Barrow 535397, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Walter Mepham B/23792, Royal Fusiliers (City of London Regiment)
Died 30 November 1917
Lives of the First World War
Private Walter Sidney Harris 532616, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private Wilfred Chapman 204000, Yorkshire Light Infantry
Died 30 November 1917
Lives of the First World War
Private William George Shelley 35469, East Surrey Regiment
Died 30 November 1917
Lives of the First World War
Private William James Avis 531958, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private William John Alexander Stuart Wakefield 534044, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private William John Black 59616. Unit: 9th Platoon, B Company, 9th Battalion, Royal Fusiliers. Death: 30 November 1917 Western Front
Died 30 November 1917
Imperial War Museum
Private William Mumford 45123, Worcestershire Regiment
Died 30 November 1917
Lives of the First World War
Private William Page 534669, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Private William Palmer 260075, North Staffordshire Regiment
Died 30 November 1917
Lives of the First World War
Private William Raynor Dell 536631, 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Ramleh : the Plain of Sharon. The bombed German aerodrome is in the foreground, and on the right the groves of trees surrounding Lydda.
30 November 1917
Imperial War Museum
Rifleman Albert Edward Dixon 49996. Unit: 13th Platoon, D Company, 1st/6th Battalion, The King's (Liverpool Regiment). Death: 30 November 1917 Missing in action Western Front.
Died 30 November 1917
Imperial War Museum
Rifleman Albert Walter Parks 323140, London Regiment
Died 30 November 1917
Lives of the First World War
Rifleman Francis E Hurst 372101, London Regiment (Post Office Rifles)
Died 30 November 1917
Lives of the First World War
Rifleman Francis E Hurst 372101. Unit: 1st/8th Battalion, City of London Regiment (Post Office Rifles). Death: 30 November 1917 Killed in action Western Front
Died 30 November 1917
Imperial War Museum
Rifleman Frank Hastings Hooper 322892, London Regiment (City of London Rifles)
Died 30 November 1917
Lives of the First World War
Rifleman Frank Hastings Hooper 322892. Unit: 1st/6th Battalion, London Regiment (City of London Rifles). Death: 30 November 1917, missing in action, Western Front. Commemorated on the Cambrai Memorial.
Died 30 November 1917
Imperial War Museum
Rifleman Frank Herbert Cavilla 324396, London Regiment
Died 30 November 1917
Lives of the First World War
Rifleman Frederick Joseph Dewland Bow 321950, London Regiment (City of London Rifles)
Died 30 November 1917
Lives of the First World War
Rifleman Frederick Percy Back 4759, 322086, London Regiment
Died 30 November 1917
Lives of the First World War
Rifleman Henry James Booth 4970, 322209, London Regiment
Died 30 November 1917
Lives of the First World War
Rifleman Horace Burford 555222, London Regiment (Queen's Westminster Rifles)
Died 30 November 1917
Lives of the First World War
Rifleman John 'Jack' Hawkes A/200883, King's Royal Rifle Corps
Died 30 November 1917
Lives of the First World War
Rifleman Owen Yarrow 375358, London Regiment (Post Office Rifles)
Died 30 November 1917
Lives of the First World War
Rifleman Thomas Mayo S/29872. Unit: 12 Battalion, The Rifle Brigade. Death: 30 November 1917 Western Front
Died 30 November 1917
Imperial War Museum
Rifleman Thomas W. Sparling, M.M. 323187, London Regiment
Died 30 November 1917
Lives of the First World War
Sapper George Albert Down 540819. Unit: 422nd Field Company, Royal Engineers. Death: 30 November 1917 Western Front.
Died 30 November 1917
Imperial War Museum
Second Lieutenant Cecil Eric Henningsen. Unit: 10th Battalion, King's Shropshire Light Infantry, attached to the Shropshire Yeomanry. Death: 30 November 1917, killed in action, Tireh, Palestine.
Died 30 November 1917
Imperial War Museum
Second Lieutenant Charles Victor Marchant , 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War
Second Lieutenant Edward Lawrence Hall. Unit: 1st/5th Battalion, Loyal North Lancashire Regiment. Death: 30 November 1917, missing in action, Western Front. Commemorated on the Cambrai Memorial, Louverval.
Died 30 November 1917
Imperial War Museum
Second Lieutenant Frank William Arnold , Royal Guernsey Light Infantry
Died 30 November 1917
Lives of the First World War
Second Lieutenant George Edward Tatum , 1/15 London Regiment (Prince of Wales' Own Civil Service Rifles)
Died 30 November 1917
Lives of the First World War