Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support exporting source media to google drive #115

Merged
merged 37 commits into from
Jan 17, 2025
Merged

Support exporting source media to google drive #115

Show file tree
Hide file tree
Changes from 23 commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
0091de7
Add 'extension' field to metadata of scraped media
philmcmahon Jan 7, 2025
a2dcfd3
Add functionality to export original source media to google drive
philmcmahon Jan 8, 2025
f083b13
Increase ephemeral storage of lambda to 10gb, memory to 512mb, to all…
philmcmahon Jan 8, 2025
5c6b98c
Set originalfilename and extension metadata on files uploaded via the…
philmcmahon Jan 8, 2025
de469a0
Prevent double . in filename
philmcmahon Jan 8, 2025
9126bbe
Tidy up filename
philmcmahon Jan 8, 2025
60ab235
Show links to individual files when export complete
philmcmahon Jan 8, 2025
56327a0
Rename ExportButton ExportForm
philmcmahon Jan 8, 2025
a5f4b4c
Fix dynamo table name
philmcmahon Jan 8, 2025
7a78c1f
Include date and time in folder name
philmcmahon Jan 8, 2025
7144de2
Bump lambda timeout to 15 minutes
philmcmahon Jan 8, 2025
b31667c
Refactor so that export returns immediately then client polls status …
philmcmahon Jan 9, 2025
9ca9a87
Fix export status reporting
philmcmahon Jan 9, 2025
4be932d
Add extra logging for export
philmcmahon Jan 9, 2025
d13c138
Disable callbackWaitsForEmptyEventLoop to allow lambda to continue ru…
philmcmahon Jan 9, 2025
3ea1060
Source media is now input media, fix logs
philmcmahon Jan 9, 2025
6dde0d2
Fix media download file path
philmcmahon Jan 9, 2025
02c368c
Log progress of s3 download
philmcmahon Jan 9, 2025
15712e9
Try setting resolution mode to callback
philmcmahon Jan 9, 2025
f0d5af5
Remove await from export promise
philmcmahon Jan 10, 2025
c803341
Add empty media-export lambda
philmcmahon Jan 10, 2025
f2e538f
Move export to google drive functionality to export-media lambda
philmcmahon Jan 10, 2025
ebe74ed
Move uploadFileToGoogleDrive to media-export service
philmcmahon Jan 13, 2025
162862c
Remove weird import syntax
philmcmahon Jan 16, 2025
eb3fb43
Add some extra zod types, document type casting
philmcmahon Jan 16, 2025
8f84419
Make error logging more relevant to devs, more sensible error handlin…
philmcmahon Jan 16, 2025
7f733fd
Tidy email text
philmcmahon Jan 16, 2025
675ff40
Move email check to getTranscriptionItem
philmcmahon Jan 16, 2025
c9c3590
Tidy exportstatuses type
philmcmahon Jan 16, 2025
71c1a6a
Tidy up export controller
philmcmahon Jan 16, 2025
7da384e
More naming improvements
philmcmahon Jan 16, 2025
db5266d
export statuses is optional
philmcmahon Jan 16, 2025
01ba659
Use proper discriminated union to return errors from getTranscription…
philmcmahon Jan 17, 2025
79bb4e6
Don't set export status to in progress after it has completed
philmcmahon Jan 17, 2025
bddc03c
attempt fix
philmcmahon Jan 17, 2025
9b3b502
Fix status response
philmcmahon Jan 17, 2025
73c1235
don't leak error information - return 404 for not found or unauthorised
philmcmahon Jan 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions .github/workflows/ci.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -70,6 +70,9 @@ jobs:
- name: Build output-handler
run: |
npm run output-handler::build
- name: Build media-export
run: |
npm run media-export::build
- name: Build worker-capacity-manager
run: |
npm run worker-capacity-manager::build
Expand Down Expand Up @@ -106,6 +109,8 @@ jobs:
- target/api.zip
transcription-service-output-handler:
- target/output-handler.zip
transcription-service-media-export:
- target/media-export.zip
transcription-service-worker-capacity-manager:
- target/worker-capacity-manager.zip
transcription-service-worker:
Expand Down
Loading
Loading