THE BRITISH LIBRARY

Digital scholarship blog

110 posts categorized "Experiments"

07 December 2018

Introducing an experimental format for learning about content mining for digital scholarship

Add comment

This post by the British Library’s Digital Curator for Western Heritage Collections, Dr Mia Ridge, reports on an experimental format designed to provide more flexible and timely training on fast-moving topics like text and data mining.

This post covers two topics – firstly, an update to the established format of sessions on our Digital Scholarship Training Programme (DSTP) to introduce ‘strands’ of related modules that cumulatively make up a ‘course’, and secondly, an overview of subjects we’ve covered related to content mining for digital scholarship with cultural heritage collections.

Introducing ‘strands’

The Digital Research team have been running the DSTP for some years now. It’s been very successful but we know that it's hard for people to get away for a whole day, so we wanted to break courses that might previously have taken 5 or 6 hours of a day into smaller modules. Shorter sessions (talks or hands-on workshops) only an hour or at most two long seemed to fit more flexibly into busy diaries. We can also reach more people with talks than with hands-on workshops, which are limited by the number of training laptops and the need to offer more individual

A 'strand' is a new, flexible format for learning and maintaining skills, with training delivered through shorter modules that combine to build attendees’ knowledge of a particular topic over time. We can repeat individual modules – for example, a shorter ‘Introduction to’ session might run more often, or target people with some existing knowledge for more advanced sessions. I haven’t formally evaluated it but I suspect that the ability to pick and choose sessions means that attendees for each module are more engaged, which makes for a better session for everyone. We've seen a lot of uptake – in some cases the 40 or so places available go almost immediately - so offering shorter sessions seems to be working.

Designing courses as individual modules makes it easier to update individual sections as technologies and platforms change. This format has several other advantages: staff find it easier to attend hour-long modules, and they can try out methods on their own collections between sessions. It takes time for attendees to collect and prepare their own data for processing with digital methods (not to mention preparation time and complexity for the instructor), so we've stayed away from this in traditional workshops.

New topics can be introduced on a 'just in time' basis as new tools and techniques emerge. This seemed to address lots of issues I was having in putting together a new course on content mining. It also makes it easier to tackle a new subject than the established 5-6 hour format, as I can pilot short sessions and use the lessons learnt in planning the next module.

The modular format also means we can invite international experts and collaborators to give talks on their specialisms with relatively low organisational overhead, as we regularly run ‘21st Century Curatorship’ talks for staff. We can link relevant staff talks, or our monthly ‘Hack and Yack’ and Digital Scholarship Reading Groups sessions to specific strands.

We originally planned to start each strand with an introductory module outlining key concepts and terms, but in reality we dived into the first one as we already had talks that'd fit lined up.

Content mining for digital scholarship with cultural heritage collections

Tom and Nora trying out AntConcFrom the course blurb: ‘Content mining (sometimes ‘text and data mining’) is a form of computational processing that uses automated analytical techniques to analyse text, images, audio-visual material, metadata and other forms of data for patterns, trends and other useful information. Content mining methods have been applied to digitised and digital historic, cultural and scientific collections to help scholars answer new research questions at scale, analysing hundreds or hundreds of thousands of items. In addition to supporting new forms of digital scholarship that apply content mining methods, methods like Named Entity Recognition or Topic Modelling can make collection items more discoverable. Content mining in cultural heritage draws on data science, 'distant reading' and other techniques to categorise items; identify concepts and entities such as people, places and events; apply sentiment analysis and analyse items at scale.’

An easily updatable mixture of introductory talks, tutorial sessions, hands-on workshops and case studies from external experts fit perfectly into the modular format, and it's worked out well, with a range of topics and formats offered so far. Sessions have included: an Introduction to Machine Learning; Computational models for detecting semantic change in historical texts (Dr Barbara McGillivray, Alan Turing Institute); Computer vision tools with Dr Giles Bergel, from the University of Oxford's Visual Geometry Group; Jupyter Notebooks/Python for simple processing and visualisations of data from In the Spotlight; Listening to the Crowd: Data Science to Understand the British Museum's Visitors (Taha Yasseri, Turing/OII); Visualising cultural heritage collections (Olivia Fletcher Vane, Royal College of Art); An Introduction to Corpus Linguistics for the Humanities (Ruth Byrne, BL and Lancaster PhD student); Corpus Analysis with AntConc.

What’s next?

My colleagues Nora McGregor, Stella Wisdom and Adi Keinan-Schoonbaert have some great ‘strands’ planned for the future, including Stella’s on ‘Emerging Formats’ and Adi’s on ‘Place’, so watch this space for updates!

29 October 2018

Using Transkribus for automated text recognition of historical Bengali Books

Add comment

In this post Tom Derrick, Digital Curator, Two Centuries of Indian Print, explains the Library's recent use of Transkribus for automated text recognition of Bengali printed books.

Are you working with digitised printed collections that you want to 'unlock' for keyword search and text mining? Maybe you have already heard about Transkribus but thought it could only be used for automated recognition of handwritten texts. If so you might be surprised to hear it also does a pretty good job with printed texts too. You might be even more surprised to hear it does an impressive job with printed texts in Indian scripts! At least that is what we have found from recent testing with a batch of 19th century printed books written in Bengali script that have been digitised through the British Library’s Two Centuries of Indian Print project.

Transkribus is a READ project and available as a free tool for users who want to automate recognition of historical documents. The British Library has already had some success using Transkribus on manuscripts from our India Office collection, and it was that which inspired me to see how it would perform on the Bengali texts, which provides an altogether different type of challenge.

For a start, most text recognition solutions either do not support Indian scripts, or do not reach close to the same level of recognition as they do with documents written in English or other Latin scripts. In part this is down to supply and demand. Mainstream providers of tools have prioritised Western customers, yet there is also the relative lack of digitised Indian texts that can be used to train text recognition engines.

These text recognition engines have also been well trained on modern dictionaries and a collection of historical texts like the Bengali books will often contain words which are no longer in use. Their aged physicality also brings with it the delights of faded print, blotchy paper and other paper-based gremlins that keeps conservationists in work yet disrupts automated text recognition. Throw in an extensive alphabet that contains more diverse and complicated character forms than English and you can start to piece together how difficult it can be to train recognition engines to achieve comparable results with Bengali texts.

So it was with more with hope than expectation I approached Transkribus. We began by selecting 50 pages from the Bengali books representing the variety of typographical and layout styles within the wider collection of c. 500,000 pages as much as possible. Not an easy task! We uploaded these to Transkribus, manually segmenting paragraphs into text regions and automating line recognition. We then manually transcribed the texts to create a ground truth which, together with the scanned page images, were used to train the recurrent neural network within Transkribus to create a model for the 5,700 transcribed words.

Transkribus_Bengali_screenshot                                 View of a segmented page from one of the British Library's Bengali books along with its transcription, within the Transkribus viewer. 

The model was tested on a few pages from the wider collection and the results clearly communicated via the graph below. The model achieved an average character error rate (CER) of 21.9%, which is comparable to the best results we have seen from other text recognition services. Word accuracy of 61% was based on the number of words that were misspelled in the automated transcription compared to the ground truth. Eventually we would like to use automated transcriptions to support keyword searching of the Bengali books online and the higher the word accuracy increases the chances of users pulling back all relevant hits from their keyword search. We noticed the results often missed the upper zone of certain Bengali characters, i.e. the part of the character or glyph which resides above the matra line that connects characters in Bengali words. Further training focused on recognition of these characters may improve the results.

TranskribusResultsGraph showing the learning curve of the Bengali model using the Transkribus HTR tool.      

Our training set of 50 pages is very small compared to other projects using Transkribus and so we think the accuracy could be vastly improved by creating more transcriptions and re-training the model. However, we're happy with these initial results and would encourage others in a similar position to give Transkribus a try.

 

 

11 September 2018

Building Library Labs around the world - the event and complete our survey!

Add comment

Posted by Mahendra Mahey, BL Labs Manager.

Original labs lab (not cropped)
Building Library Labs

Around the world, leading national, state, university and public libraries are creating 'digital lab type environments' so that their digitised and born digital collections / data can be opened up and re-used for creative, innovative and inspiring projects by everyone such as digital researchers, artists, entrepreneurs and educators.

BL Labs, which has now been running for five years, is organising what we believe will be the first ever event of its kind in the world! We are bringing together national, state and university libraries with existing or planned digital 'Labs-style' teams for an invite-only workshop this Thursday 13 September and Friday 14 September, 2018.

A few months ago, we sent out special invitations to these organisations. We were delighted by the excitement generated, and by the tremendous response we received. Over 40 institutions from North America, Europe, Asia and Africa will be attending the workshop at the British Library this week. We have planned plenty of opportunities for networking, sharing lessons learned, and telling each other about innovative projects and services that are using digital collections / data in new and interesting ways. We aim to work together in the spirit of collaboration so that we can continue to build even better Library Labs for our users in the future.

Our packed programme includes:

  • 6 presentations covering topics such as those in our international Library Labs Survey;
  • 4 stories of how national Library Labs are developing in the UK, Austria, Denmark and the Netherlands;
  • 12 lightning talks with topics ranging from 3D-Imaging to Crowdsourcing;
  • 12 parallel discussion groups focusing on subjects such as funding, technical infrastructure and user engagement;
  • 3 plenary debates looking at the value to national Libraries of Labs environments and digital research, and how we will move forward as a group after this event.

We will collate and edit the outputs of this workshop in a report detailing the current landscape of digital Labs in national, state, university and public Libraries around the world.

If you represent one of these institutions, it's still not too late to participate, and you can do so in a few ways:

  • Our 'Building Library Labs' survey is still open, and if you work in or represent a digital Library Lab in one of our sectors, your input will be particularly valuable;
  • You may be able to participate remotely in this week's event in real time through Skype;
  • You can contribute to a collaborative document which delegates are adding to during the event.

If you are interested in one of these options, contact: mahendra.mahey@bl.uk.

Please note, that event is being videoed and we will be putting up clips on our YouTube channel soon after the workshop.

We will also return to this blog and let you know how we got on, and how you can access some of the other outputs from the event. Watch this space!

 

 

 

23 August 2018

BL Labs Symposium (2018): Book your place for Mon 12-Nov-2018

Add comment

The BL Labs team are pleased to announce that the sixth annual British Library Labs Symposium will be held on Monday 12 November 2018, from 9:30 - 17:30 in the British Library Knowledge Centre, St Pancras. The event is free, and you must book a ticket in advance. Last year's event was a sell out, so don't miss out!

The Symposium showcases innovative and inspiring projects which use the British Library’s digital content, providing a platform for development, networking and debate in the Digital Scholarship field as well as being a focus on the creative reuse of digital collections and data in the cultural heritage sector.

We are very proud to announce that this year's keynote will be delivered by Daniel Pett, Head of Digital and IT at the Fitzwilliam Museum, University of Cambridge.

Daniel Pett
Daniel Pett will be giving the keynote at this year's BL Labs Symposium. Photograph Copyright Chiara Bonacchi (University of Stirling).

  Dan read archaeology at UCL and Cambridge (but played too much rugby) and then worked in IT on the trading floor of Dresdner Kleinwort Benson. Until February this year, he was Digital Humanities lead at the British Museum, where he designed and implemented digital practises connecting humanities research, museum practice, and the creative industries. He is an advocate of open access, open source and reproducible research. He designed and built the award-winning Portable Antiquities Scheme database (which holds records of over 1.3 million objects) and enabled collaboration through projects working on linked and open data (LOD) with the Institute for the Study of the Ancient World (New York University) (ISAWNYU) and the American Numismatic Society. He has worked with crowdsourcing and crowdfunding (MicroPasts), and developed the British Museum's 3D capture reputation. He holds Honorary posts at UCL Institute of Archaeology and the Centre for Digital Humanities and publishes regularly in the fields of museum studies, archaeology and digital humanities.

Dan's keynote will reflect on his years of experience in assessing the value, impact and importance of experimenting with, re-imagining and re-mixing cultural heritage digital collections in Galleries, Libraries, Archives and Museums. Dan will follow in the footsteps of previous prestigious BL Labs keynote speakers: Josie Fraser (2017); Melissa Terras (2016); David De Roure and George Oates (2015); Tim Hitchcock (2014); and Bill Thompson and Andrew Prescott in 2013.

Stella Wisdom (Digital Curator for Contemporary British Collections at the British Library) will give an update on some exciting and innovative projects she and other colleagues have been working on within Digital Scholarship. Mia Ridge (Digital Curator for Western Heritage Collections at the British Library) will talk about a major and ambitious data science/digital humanities project 'Living with Machines' the British Library is about to embark upon, in collaboration with the Alan Turing Institute for data science and artificial intelligence.Throughout the day, there will be several announcements and presentations from nominated and winning projects for the BL Labs Awards 2018, which recognise work that have used the British Library’s digital content in four areas: Research, Artistic, Commercial, and Educational. The closing date for the BL Labs Awards is 11 October, 2018, so it's not too late to nominate someone/a team, or enter your own project! There will also be a chance to find out who has been nominated and recognised for the British Library Staff Award 2018 which showcases the work of an outstanding individual (or team) at the British Library who has worked creatively and originally with the British Library's digital collections and data (nominations close 12 October 2018).

Adam Farquhar (Head of Digital Scholarship at the British Library) will give an update about the future of BL Labs and report on a special event held in September 2018 for invited attendees from National, State, University and Public Libraries and Institutions around the world, where they were able to share best practices in building 'labs style environmentsfor their institutions' digital collections and data.

There will be a 'sneak peek' of an art exhibition in development entitled 'Imaginary Cities' by the visual artist and researcher Michael Takeo Magruder. His practice  draws upon working with information systems such as live and algorithmically generated data, 3D printing and virtual reality and combining modern / traditional techniques such as gold / silver gilding and etching. Michael's exhibition will build on the work he has been doing with BL Labs over the last few years using digitised 18th and 19th century urban maps bringing analog and digital outputs together. The exhibition will be staged in the British Library's entrance hall in April and May 2019 and will be free to visit.

Finally, we have an inspiring talk lined up to round the day off (more information about this will be announced soon), and - as is our tradition - the symposium will conclude with a reception at which delegates and staff can mingle and network over a drink and nibbles.

So book your place for the Symposium today and we look forward to seeing new faces and meeting old friends again!

For any further information, please contact labs@bl.uk

Posted by Mahendra Mahey and Eleanor Cooper (BL Labs Team)

06 August 2018

Reminder about the 2018 BL Labs Awards: enter before midnight Thursday 11th October!

Add comment

With three months to go before the submission deadline, we would like to remind you about the 2018 British Library Labs Awards!

The BL Labs Awards are a way of formally recognising outstanding and innovative work that has been created using the British Library’s digital collections and data.

Have you been working on a project that uses digitised material from the British Library's collections? If so, we'd like to encourage you to enter that project for an award in one of our categories.

This year, BL Labs will be giving awards for work in four key areas:

  • Research - A project or activity which shows the development of new knowledge, research methods, or tools.
  • Commercial - An activity that delivers or develops commercial value in the context of new products, tools, or services that build on, incorporate, or enhance the Library's digital content.
  • Artistic - An artistic or creative endeavour which inspires, stimulates, amazes and provokes.
  • Teaching / Learning - Quality learning experiences created for learners of any age and ability that use the Library's digital content.

BLAwards2018
BL Labs Awards 2017 Winners (Top-Left- Research Award Winner – A large-scale comparison of world music corpora with computational tools , Top-Right (Commercial Award Winner – Movable Type: The Card Game), Bottom-Left(Artistic Award Winner – Imaginary Cities) and Bottom-Right (Teaching / Learning Award Winner – Vittoria’s World of Stories)

There is also a Staff Award which recognises a project completed by a staff member or team, with the winner and runner up being announced at the Symposium along with the other award winners.

The closing date for entering your work for the 2018 round of BL Labs Awards is midnight BST on Thursday 11th October (2018). Please submit your entry and/or help us spread the word to all interested and relevant parties over the next few months. This will ensure we have another year of fantastic digital-based projects highlighted by the Awards!

Read more about the Awards (FAQs, Terms & Conditions etc), practice your application with this text version, and then submit your entry online!

The entries will be shortlisted after the submission deadline (11/10/2018) has passed, and selected shortlisted entrants will be notified via email by midnight BST on Friday 26th October 2018. 

A prize of £500 will be awarded to the winner and £100 to the runner up in each of the Awards categories at the BL Labs Symposium on 12th November 2018 at the British Library, St Pancras, London.

The talent of the BL Labs Awards winners and runners up from the last three years has resulted in a remarkable and varied collection of innovative projects. You can read about some of last year's Awards winners and runners up in our other blogs, links below:

BLAwards2018-Staff
British Library Labs Staff Award Winner – Two Centuries of Indian Print

To act as a source of inspiration for future awards entrants, all entries submitted for awards in previous years can be browsed in our online Awards archive.

For any further information about BL Labs or our Awards, please contact us at labs@bl.uk.

30 July 2018

British Library Labs Staff Awards 2018: Looking for entries now!

Add comment

Four-light-bulbs

Nominate a British Library staff member or a team that has done something exciting, innovative and cool with the British Library’s digital collections or data.

The 2018 British Library Labs Staff Award, now in its third year, gives recognition to current British Library staff who have created something brilliant using the Library’s digital collections or data

Perhaps you know of a project that developed new forms of knowledge, or an activity that delivered commercial value to the library. Did the person or team create an artistic work that inspired, stimulated, amazed and provoked? Do you know of a project developed by the Library where quality learning experiences were generated using the Library’s digital content? 

You may nominate a current member of British Library staff, a team, or yourself, for the Staff Award using this form.

The deadline for submission is 12:00 (BST), Friday 12 October 2018.

Nominees will be highlighted on Monday 12 November 2018 at the British Library Labs Annual Symposium where some (winners and runners-up) will also be asked to talk about their projects.

You can see the projects submitted by members of staff for the last two years' awards in our online archive, as well as blogs for last year's winners and runners-up.

The Staff Award complements the British Library Labs Awards, introduced in 2015, which recognise outstanding work that has been done in the broader community. Last year’s winners in the public competition drew attention to artistic, research, teaching & learning, and commercial activities that used our digital collections.

British Library Labs is a project within the Digital Scholarship department at the British Library that supports and inspires the use of the Library's digital collections and data in exciting and innovative ways. It is funded by the Andrew W. Mellon Foundation.

If you have any questions, please contact us at labs@bl.uk.

@bl_labs #bldigital @bl_digischol

14 May 2018

Seeing British Library collections through a digital lens

Add comment

Digital Curator Mia Ridge writes: in this guest post, Dr Giles Bergel describes some experiments with the Library's digitised images...

The University of Oxford’s Visual Geometry Group has been working with a number of British Library curators to apply computer vision technology to their collections. On April 5 of this year I was invited by BL Digital Curator Dr. Mia Ridge to St. Pancras to showcase some of this work and to give curators the opportunity to try the tools out for themselves.  

Image1
Visual Geometry’s VISE tool matching two identical images from separate books digitised for the British Library’s Two Centuries of Indian Print project.

Computer vision - the extraction of meaning from images - has made considerable strides in recent years, particularly through the application of so-called ‘deep learning’ to large datasets. Cultural collections provide some of the most interesting test-cases for computer vision researchers, due to their complexity; the intensity of interest that researchers bring to them; and to their importance for human well-being. Can computers see collections as humans do? Computer vision is perhaps better regarded as a powerful lens rather than as a substitute for human curation. A computer can search a large collection of images far more quickly than can a single picture researcher: while it will not bring the same contextual understanding to bear on an image, it has the advantage of speed and comprehensiveness. Sometimes, a computer vision system can surprise the researcher by suggesting similarities that weren’t readily apparent.

As a relatively new technology, computer vision attracts legitimate concerns about privacy, ethics and fairness. By making its state of the art tools freely available, Visual Geometry hope to encourage experimentation and responsible use, and to enlist users to help determine what they can and cannot do. Cultural collections provide a searching test-case for the state of the art, due to their diversity as media (prints, paintings, stamped images, photographs, film and more) each of which invite different responses. One BL curator made a telling point by searching the BBC News collection with the term 'football': the system was presented with images previously tagged with that word that related to American, Gaelic, Rugby and Association football. Although inconclusive due to lack of sufficiently specific training data, the test asked whether a computer could (or should) pick the most popular instances; attempt to generalise across multiple meanings; or discern separate usages. Despite increases in processing power and in software methods, computers' ability to generalise; to extract semantic meaning from images or texts; and to cope with overlapping or ambiguous concepts remains very basic.  

Other tests with BL images have been more immediately successful. Visual Geometry's Traherne tool, developed originally to detect differences in typesetting in early printed books, worked well with many materials that exhibit small differences, such as postage stamps or doctored photographs. Visual Geometry's Image Search Engine (VISE) has shown itself capable of retrieving matching illustrations in books digitised for the Library's Indian Print project, as well as certain bookbinding features, or popular printed ballads. Some years ago Visual Geometry produced a search interface for the Library's 1 Million Images release. A collaboration between the Library's Endangered Archives programme and Oxford researcher David Zeitlyn on the archive of Cameroonian studio photographer Jacques Toussele employed facial recognition as well as pattern detection. VGG's facial recognition software works on video (BBC News, for example) as well as still photographs and art, and is soon to be freely released to join other tools under the banner of the Seebibyte Project.    

I'll be returning to the Library in June to help curators explore using the tools with their own images. For more information on the work of Visual Geometry on cultural collections, subscribe to the project's Google Group or contact Giles Bergel.      

Dr. Giles Bergel is a digital humanist based in the Visual Geometry Group in the Department of Engineering Science at the University of Oxford.  

The event was supported by the Seebibyte project under an EPSRC Programme Grant EP/M013774/1

 

04 May 2018

What do deep learning, community archives, Livy and the politics of artefacts have in common?

Add comment

They're all topics we've discussed in the British Library's Digital Scholarship Reading Group. Digital Curator Mia Ridge explains...

A few months after I submitted my PhD and joined the Library's Digital Scholarship team, I realised that it'd be hard to keep up with trends in digital scholarship unless I made a special effort. I also figured I couldn't be the only person in that situation. I've always loved a reading group, so a Digital Scholarship Reading Group seemed a good way to read and discuss at least one topical article a month and meet other people in the Library at the same time.

It'd be boring if it was just members of the Digital Scholarship team violently agreeing with each other, so after a few pilot sessions, I organised posters for staff notice boards to help make it clear that all were welcome, regardless of job title or seniority. After a year or so, we changed the time to allow for more people who work set shifts to attend.

There's a bit of admin each month  - whoever's coordinating the group for that month will update the standing calendar entry, post upcoming topics on our internal staff network, and sometimes ask the Internal Communications team to include them in newsletters.

We usually have eight to ten people turn up, but our last session had over 20 people! This may have been because we had a special guest speaker (thank you, Jane Winters!), because it was about digital humanities rather than digital scholarship, or the result of working with the Internal Comms team to send an all-staff email invitation to attend. The discussion is richest when we have people from a range of different departments and disciplines. A nice side-effect of encouraging attendance from across the Library is learning a little more about people's roles in other departments.

Reading group notice

I've experimented with different ways of selecting articles - an internal poll seemed to work well - and I love it when an attendee suggests a topic from their field, especially as quite a few Library staff are working towards formal degrees outside work. Other discussions are inspired by topics in the news or questions we've been asked as digital curators. I've experimented with length and tone, from academic, peer-reviewed articles to news or magazine articles and videos. Providing a few options for a particular topic seems to work well, as when we had a TED talk, scholarly article or peer-reviewed technical article on the same topic of bias in algorithms.

We usually meet on the first Tuesday of each month.Thanks to everyone who's added to the conversation, suggested a topic or article, or coordinated the discussion - I hope you've all enjoyed it as much as I have! Get in touch (@mia_out or via bl.uk/digital) if you'd like to know more or to suggest a topic or article.

Here's what we've met to discuss so far:

Allington, Daniel, Sarah Brouillette, and David Golumbia, ‘Neoliberal Tools (and Archives): A Political History of Digital Humanities’, Los Angeles Review of Books <https://lareviewofbooks.org/article/neoliberal-tools-archives-political-history-digital-humanities/>
Boyd, danah, and Kate Crawford, ‘Critical Questions for Big Data: Provocations for a Cultural, Technological, and Scholarly Phenomenon’, Information, Communication & Society, 15 (2012), 662–79 <https://doi.org/10.1080/1369118X.2012.678878>
Brügger, Niels, ‘Digital Humanities in the 21st Century: Digital Material as a Driving Force’, Digital Humanities Quarterly, 010 (2016)
Buolamwini, Joy, ‘How I’m Fighting Bias in Algorithms’ <https://www.ted.com/talks/joy_buolamwini_how_i_m_fighting_bias_in_algorithms>
Buolamwini, Joy, and Timnit Gebru, ‘Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification’, 15
Deloit, Corine, Neil Wilson, Luca Costabello, and Pierre-Yves Vandenbussche, ‘The British National Bibliography: Who Uses Our Linked Data?’ (presented at the International Conference on Dublin Core and Metadata Applications, Copenhagen, Denmark, 2016) <http://dcevents.dublincore.org/IntConf/dc-2016/paper/viewFile/420/471>
Digital Humanities Research, Teaching and Practice in the UK Landscape Report, 2017
Dinsman, Melissa, ‘The Digital in the Humanities: An Interview with Bethany Nowviskie - Los Angeles Review of Books’, Los Angeles Review of Books <https://lareviewofbooks.org/article/digital-humanities-interview-bethany-nowviskie/>
Drucker, Johanna, ‘Humanities Approaches to Graphical Display’, 5 (2011) <http://www.digitalhumanities.org/dhq/vol/5/1/000091/000091.html>
Earhart, Amy E., and Toniesha L. Taylor, ‘Pedagogies of Race: Digital Humanities in the Age of Ferguson’, in Debates in the Digital Humanities <http://dhdebates.gc.cuny.edu/debates/text/72>
Elford, Jana Smith, ‘Recovering Women’s History with Network Analysis: A Case Study of the Fabian News’, The Journal of Modern Periodical Studies, 6 (2016), 191–213 <https://doi.org/10.5325/jmodeperistud.6.2.0191>
Evans, Meredith R., ‘Modern Special Collections: Embracing the Future While Taking Care of the Past’, New Review of Academic Librarianship, 21 (2015), 116–28 <https://doi.org/10.1080/13614533.2015.1040926>
Gilliland, Anne, and Andrew Flinn, ‘Community Archives: What Are We Really Talking About?’, in Keynote Speech Delivered at the CIRN Prato Community Informatics Conference, 2013 <http://ccnr.infotech.monash.edu/assets/docs/prato2013_papers/gilliland_flinn_keynote.pdf>
Graham, Shawn, Ian Milligan, and Scott Weingart, ‘Putting Big Data to Good Use: Historical Case Studies’, in The Historian’s Macroscope: Big Digital History, 2014 <http://www.themacroscope.org/?page_id=599>
Grimmelmann, James, ‘The Virtues of Moderation’, TECHNOLOGY Vol., 17 (2015), 68
Jardine, Lisa, and Anthony Grafton, ‘“Studied for Action”: How Gabriel Harvey Read His Livy’, Past & Present, 1990, 30–78 <http://www.jstor.org/stable/650933>
LeCun, Yann, Yoshua Bengio, and Geoffrey Hinton, ‘Deep Learning’, Nature, 521 (2015), 436–44 <https://doi.org/10.1038/nature14539>
Lohr, Steve, ‘Facial Recognition Is Accurate, If You’re a White Guy’, The New York Times, 14 February 2018, section Technology <https://www.nytimes.com/2018/02/09/technology/facial-recognition-race-artificial-intelligence.html>
Moravec, Michelle, ‘Feminist Research Practices and Digital Archives’, Australian Feminist Studies, 32 (2017), 186–201 <https://doi.org/10.1080/08164649.2017.1357006>
Prescott, Andrew, ‘Searching for Dr. Johnson: The Digitisation of the Burney Newspaper Collection’, 2018, 49–71 <https://doi.org/10.1163/9789004362871_004>
Rawson, Katie, and Trevor Muñoz, ‘Against Cleaning’, 2016 <http://www.curatingmenus.org/articles/against-cleaning/>
 
Self, Will, and William Watkins, ‘There Will Be Blood’, Times Higher Education (THE), 14 July 2016 <https://www.timeshighereducation.com/digital-editions/14-july-2016-digital-edition>
 
Standing, Susan, and Craig Standing, ‘The Ethical Use of Crowdsourcing’, Business Ethics: A European Review, n/a-n/a <https://doi.org/10.1111/beer.12173>
Verwayen, Harry, Julia Fallon, Julia Schellenberg, and Panagiotis Kyrou, Impact Playbook for Museums, Libraries and Archives (Europeana Foundation, 2017)
Winner, Langdon, ‘Do Artifacts Have Politics?’, Daedalus, 1980, 121–136 <http://www.jstor.org/stable/20024652>
Witmore, Michael, ‘Latour, the Digital Humanities, and the Divided Kingdom of Knowledge’, New Literary History, 47 (2016), 353–75 <https://doi.org/10.1353/nlh.2016.0018>