Colossus S3 api implementation

[ignazio-bovo]

Progress

• edit controller logic to incorporate s3 upload and file fetching for user request on filesApi.get
• document upload object flow
• improve in memory cache logic for stored objects
• improve custom multer Storage engine implementation in order to accomodate upload request
• define Abstract class for generic cloud storage provider
• Document new class hierarchy
• Adapt synch flow for connection handler (est. 4hrs)
• implement ConnectionHandler for the aws typescript api (est 4hrs)
  • if necessary augment AbstractConnectionHandler for getting a list of assets on the cloud bucket for local cache setup
• Add member to object cache for object that it is stored on remote bucket 10 min
• Files Api should detect whether file is on remote or simply return 30 min
• Accept data object should upload the file and add its location (either on local volume or remote to the cache) 2hrs
• Get file should get the file from remote using Abstract connection handler and pipe the stream to the request 2hrs
• Revert Changes on storage engine (only accepted objects should be added to the bucket) 2 min
• Refactor abstract connection handler using only async parts: 10 mins