Framework to develop datapipelines from files on disk to full dissemenation API
