Skip to content

module to read LDES (CoGhent) and export to Postgres and other datafames.

License

Notifications You must be signed in to change notification settings

sofiedroid/LDES_TO_PG

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LDES_TO_PG [WORK IN PROGRESS]

replicate coghent Linked Data Event Streams into PostgreSQL docker container or export as csv, xcel.

Available collections:

  • Design Museum Gent (DMG)
  • Huis van Alijn (HVA)
  • Industriemuseum (IM)
  • STAM
  • Archief Gent (ARCHIEF)
  • Thesaurus (conceptlist)
  • Agent list: agents (creators, persons and intstitutions) that are related to the published objects.

INSTALL

LDES_TO_PG makes use of @treecg/actor-init-ldes-client, metadata harvester for Linked Data Event Streams. In order to use this program make sure to install this first.

actor-init-ldes-client --parameter ${PARAMETER} ${URL}

USE

python3 ldes_to_pg.py --fetch --timestamp

for example:

python3 ldes_to_pg.py --fetch DMG --timestamp 2021-07-30T15:48:12:309Z

depending on the datetime defined and the number of data collections to fetch the process can take a while.

Parameter Description Possible values
fetch define collectiions to fetch from CoGhent LDES DMG, HVA, STAM, IM, ARCHIEF, THESAURUS, AGENTS
timestamp datetime to prune relations that have a lower datetime value for example: 2020-01-01T00:00:00, default = "2021-01-01T15:48:12.309Z"
result define the wished for result (pg=postrgres) pg, csv, xlsx

License

This project is released as an open-source project under the MIT License

About

module to read LDES (CoGhent) and export to Postgres and other datafames.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%