Currently, Wikidata, or any other Wikibase instance, is being populated from external data sources mostly manually, by creating ad-hoc data transformation scripts. Usually, these scripts are run once, and that is it. Given the heterogeneity of the source data and languages used to transform them, this means the scripts are hard or impossible to maintain and unable to run periodically in an automated fashion to keep Wikidata up-to-date.
In this session, we would like to demonstrate our work-in-progress in our project utilizing LinkedPipes ETL - a tool for data transformation pipelines - to load data to Wikibases and Wikidata.
Industry, innovation, and infrastructure: Enabling volunteers to better automate bulk loading of data into Wikidata using sharable data transformation pipelines helps to make these processes more unified and therefore sustainable.
Each Space at Wikimania 2019 will have specific format requests. The program design prioritises submissions which are future-oriented and directly engage the audience. The format of this submission is a:
One of these options:
Option 1: Presentation - 20 minutes
Option 2: Roundtable workshop - 10 minutes of presenting, 30 to 60 minutes of hands-on for interested attendees