Commit Graph

16 Commits

Author SHA1 Message Date
axibayuit
364e7c8643 fix: pass oid to uploadMultipart for multipart complete request 2025-12-30 21:17:28 +08:00
axibayuit
e973c65e9c feat(huggingface): implement direct upload for large files (>20MB)
- Add frontend direct upload to HuggingFace S3, bypassing CF Workers limits
- Add /api/huggingface/getUploadUrl endpoint to get LFS upload URLs
- Add /api/huggingface/commitUpload endpoint to commit file references
- Support multipart upload for very large files
- SHA256 computed in frontend to avoid CF Workers CPU timeout
- Small files (<20MB) still use proxy upload through CF Workers
2025-12-30 20:42:38 +08:00
axibayuit
fd92a024fd feat: optimize HuggingFace upload - compute SHA256 on frontend to avoid CF Workers CPU timeout 2025-12-30 20:31:33 +08:00
axibayuit
6840484c2f feat: implement native LFS upload protocol for HuggingFace (no external SDK) 2025-12-30 20:08:28 +08:00
axibayuit
fc01dfe53f fix: update HuggingFace SDK to v0.23.0 and disable Xet/WebWorkers for CF Workers compatibility 2025-12-30 20:04:25 +08:00
axibayuit
cfbfb3eb8c fix: use NDJSON format for HuggingFace commit API 2025-12-30 19:57:50 +08:00
axibayuit
2f1e9df5a0 fix: use string fields instead of JSON blob for HuggingFace commit API 2025-12-30 19:52:36 +08:00
axibayuit
f768f1cb3b fix: correct HuggingFace commit API format - header as JSON blob 2025-12-30 19:46:36 +08:00
axibayuit
2943f99e54 fix: use POST commit API with multipart form data for HuggingFace upload 2025-12-30 19:42:10 +08:00
axibayuit
78256d1816 fix: simplify HuggingFace upload - direct PUT without encoding 2025-12-30 18:58:06 +08:00
axibayuit
e7d504cff1 fix: use multipart form upload for HuggingFace to avoid CPU timeout 2025-12-30 18:48:25 +08:00
axibayuit
72c24547c0 fix: use direct binary upload instead of base64 to avoid CPU timeout 2025-12-30 18:44:42 +08:00
axibayuit
9d88863671 fix: use correct HuggingFace commit API format with base64 encoding 2025-12-30 18:22:17 +08:00
axibayuit
7596424135 fix: use simple upload API for HuggingFace 2025-12-30 18:06:09 +08:00
axibayuit
13877de84c fix: update HuggingFace API to use LFS upload method 2025-12-30 18:05:05 +08:00
axibayuit
7ef6fd48ac feat: add HuggingFace storage channel support
- Add HuggingFace API wrapper class (huggingfaceAPI.js)
- Support upload, download, delete operations via HuggingFace Hub API
- Support public repos (unlimited storage) and private repos (100GB limit)
- Private repos: server proxies requests with Authorization header
- Auto-create repo if not exists (with write token)
- Add HuggingFace to auto-retry channel list
- Environment variables: HF_TOKEN, HF_REPO, HF_PRIVATE
- Support load balancing for multiple HuggingFace channels
2025-12-30 17:46:11 +08:00