OAeBU Workflows

OAeBU Workflows provides Apache Airflow workflows for fetching, processing and analysing data about Open Access Books.

The workflows include: Directory of Open Access Books (DOAB), Google Analytics, Google Books, JSTOR, Oapen IRUS UK, Oapen Metadata, Onix, UCL Discovery and an Onix Workflow for combining all of this data.

Telescope Workflows

A telescope a type of workflow used to ingest data from different data sources, and to run workflows that process and output data to other places. Workflows are built on top of Apache Airflow’s DAGs.

• Telescope Workflows
  • Directory of Open Access Books
  • Google Analytics
  • Google Books
  • JSTOR
  • OAPEN Metadata
  • OAPEN Irus Uk
  • ONIX
  • UCL Discovery

Analytic Workflows

Analytic workflows process the data ingested by telescope workflows and are also built on top of Apache Airflow DAGs.

• Analytic Workflows
  • ONIX workflow Step 1 - Mapping Book Products
  • ONIX workflow Step 2 - Linking Metircs
  • ONIX workflow Step 3 - Exporting to Elasticsearch

License & Contributing Guidelines

Information about licenses, contributing guidelines etc.

• License

Python API Reference

Documentation for the academic-observatory-workflow Python API.

• API Reference
  • oaebu_workflows
    • Subpackages
    • Submodules