113 Commits

Author	SHA1	Message	Date
Daniel Salazar	63732cbc8a	wip: self hoast modes	2026-05-03 00:46:19 -07:00
Daniel Salazar	5b35a5db69	errors for fs (#2884) ... * remove bloated tests and * errors for fs Co-authored-by: Copilot <copilot@github.com> --------- Co-authored-by: Copilot <copilot@github.com>	2026-05-01 23:24:05 -07:00
Nariman Jelveh	60ea48dbaa	Remove gross legacy tools and docs (#2873)	2026-05-01 12:58:36 -07:00
Daniel Salazar	d4d78ac7db	rework: change backend and backend extensions to use simpler code structure and patterns (#2815) ... * fix: dynamodb health checks and client recreation (#2789) * wip: no nanoServices groundwork * feat: data clients in new shape * wip: auth and perms in new system * more wip * middlewaters mainly done * wip: fsv2 in new layout * old fs v2 migration * driver system * driver and old fs fixes * ai drivers wip * stream support * metering in ai chat driver * wip: new auth * rate limit and auth routes * captcha and anti csrf * fix: types * auth store * app logic * wip most other dricvers * fs * mostly kill all legacy stuff * fs finish * fix: redis usage * ai controller * driver cleanup * socket io in v2 * broadcast and crudq stuff * subdomains * notifcations and shares * fix bad syntaxes * auth wip Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * extensions * extension setup * more routes * sql migrations and default services * home router * tier 7 * everything else * everything else * remaining missing bits * server health * logs * cleanup * deps * cleanup 2 * more cleanup 2 * boot * fix launch * config fix * move file * fix: tsconfig things * fix: extension loading * launching * fix: drivers * fix: others * fix: icons * fix: file uploads * fs fixes * fix: fs api * fix: dev-center * config * add back telemetry * lint stuff * husky hooks * fix: fs oss * fix: config migration * config migration * migrate scripts + replicate * runner * fix: merge defafult config * fix: default region * fix: api domain * fix paths in readfile * fix fs entry default s3 * NS: Remove Referral && Entri Service * dep cleanups * fix: static assets * fix: kv and perms * fix: driver registrations * fix: home mapping * fix: rao * adding back 500 alarm * fix: build paths * fix: fs and kv shapes * fix: kv shape * more kv coercing and ai chat matching format as prior * fix: private app gates * private app caches * fix: whole bunch of legacy shape issues * update template jsonc * fix caching partial oidc and fs signed paths * more oidc fixes * fix: wip * fix: private apps * admin route fixes * fix: last few things hopefully * claude uploads * fix security for app only routes * fix kv system namespace * stuff * fix: app and kv and suggested apps * fix:open item * fix: FS operations * fix: default app icons * add back token-read and WSL support * metering fixes * fix: fsEntry * perm scanners and implicators * proper download endpoint * fix: download * fix anti csrft on v2 * fix file extensions, app icons * fold in v1 fixes from origin/main into v2 equivalents Re-applies the v1 fixes that landed on origin/main into their v2 counterparts since the v1 files were deleted on DS/wip during the v2 migration. v1 commits referenced below. - SQLBatcher: flush immediately when queue hits maxBatchSize instead of racing the timer (v1 12f48238). - RedisClient: drop maxRetriesPerRequest from 2 to 1 to shrink failure window (v1 b6776ab4). - ChatCompletionDriver: default minimumCredits to 1 when unset/zero so zero-cost precheck doesn't auto-pass (v1 36bd6073). - OpenAiImageProvider: add gpt-image-2 support — open-ended size rules, token-based cost estimator, arbitrary-size normalizer, isGpt prefix broadened to gpt-image- (v1 f14f1bf4). models.ts auto-merged via rename detection. - AppStore: bump row cache TTL from 5m to 24h (v1 6b3196ed). Not ported: v1 app-object Redis cache (bdfa12b5/b886dde3) — v2's #toClient recomputes filetype_associations/created_from_origin per read; adding a second cache layer is a larger change for a follow-up. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * remoe anti-csrf from auth routes that had not used them * more icon fixes * fix worker functionality * fix: app and subdomain es Co-authored-by: Copilot <copilot@github.com> * fix PUT-761 * fix: PUT-748 * fix: rename fsService * Add security back to WorkerDriver * Migrate worker from fsEntry to fs. Fix cache issue * remove ability to create symlinks * strict webdav acl * require auth for wisp * chore: service renames * Add metering back to puter peer api * fix: PUT-760 PUT-749 * fix: PUT-746 * fix: peer cost Co-authored-by: Copilot <copilot@github.com> * fix: 771 * change order of peer controller * fix: create appdata folder for app on get auth token * fix: align delete site and list sites * delete: putility * fix subdomains * Add support for tilde in subdomains, fix subdomain update * cleanup PeerController.ts and fix billing oversight (#2844) * fix: PUT-786 * fix: bugs * fix: issues with multiple subdomain queries, or permission checks * fix: harden response shapes to not contain uneeded fields * fix: move state to redis * fix: missing kv methods + better sec Co-authored-by: Copilot <copilot@github.com> * fix: subdomainStore limit * fix: missing path resolution Co-authored-by: Copilot <copilot@github.com> * fs fixes * fix: undef error * fix fs + cleanup * fix: npm audit fixes * heal path entries where missing Co-authored-by: Copilot <copilot@github.com> * fix: caching Co-authored-by: Copilot <copilot@github.com> * fix: cache inconsistencies Co-authored-by: Copilot <copilot@github.com> * fix: app driver metadata Co-authored-by: Copilot <copilot@github.com> * remove extraneous comma * fix: associated app icons * fix: bad tool call * Add validation to WorkerDriver#getFilePaths * misc fs and auth issues Co-authored-by: Copilot <copilot@github.com> * fix: oidc errors Co-authored-by: Copilot <copilot@github.com> * fix: PUT-797 * fix: legacy appdata_app Co-authored-by: Copilot <copilot@github.com> * fix: add alert logs Co-authored-by: Copilot <copilot@github.com> * fix: error handling * Disable sharecontroller * fix: remove private user identifier for ai * fix: private app fixes * Add backback signup_server * fix: completionId size Co-authored-by: Copilot <copilot@github.com> * fix: revalidate path for oidc * fix: revalidate path for oidc * fix: email validation Co-authored-by: Copilot <copilot@github.com> * fix: user create query * fix: middleware extensions Co-authored-by: Copilot <copilot@github.com> * use x-forwarded-for for req ip forwarded * fix: missing last_activity ts * feat: add cache broadcast to subdomains * fix: update config typing --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Co-authored-by: ProgrammerIn-wonderland <3838shah@gmail.com> Co-authored-by: Copilot <copilot@github.com> Co-authored-by: Nariman Jelveh <nj@puter.com> Co-authored-by: velzie <velzie@velzie.rip>	2026-04-30 12:13:43 -07:00
ProgrammerIn-wonderland	389e11f33b	Ns/simplify 2 (#2790) ... * Remove mostly unused TechnicalError and featureflag. Fold Group into GroupService. * move modutil to util * remove unused public/assets * Remove anomaly service, fold logic into groups * remove unused modules * Remove AnomalyService import from tests * remove shutdownservice * remove unused filetracker service * [will break prod] remove Puter AI Module, inline to coremodue * MariaDB compatibility	2026-04-15 12:03:51 -04:00
Daniel Salazar	99d96edd9c	feat: s3 fs in oss (#2761) ... * feat: s3 fs in oss * feat: new endpoints in OSS * fix: name of fs extension * perf: signed uploads * fix: await socket events to align fs events * fix: default bucket names * fix: backend tests * fix: deps * fix: order	2026-04-02 11:20:59 -07:00
Neal Shah	4fb84bc117	add configurable backend (#2452)	2026-02-09 21:47:12 -08:00
KernelDeimos	20b5662704	dev(backend): make data-access an essential module	2026-01-21 23:00:45 -05:00
Daniel Salazar	4e6d9c9f33	perf: improve tel + decrease logs (#2309) ... * perfmon: lower healthcheck status cache, add kv health signal * perf: improve tel + decrease logs * logs	2026-01-20 20:21:08 -08:00
KernelDeimos	f8bdcf8470	dev: [+] DataAccessModule > AppService > select() ... This commit adds the DataAccessModule, which is where replacement "flatter" implementations for what is currently implemented via EntityStorage/OM will be developed. This commit also adds AppService, which is where the `crud-q` implementor for apps will be implemented. This commit adds the `select()` implementation for AppService. Currently it is missing many behaviors for parity with the current ES/OM implementation including: - coercion of boolean values - nested objects and their properties - `icon_size` parameter support	2025-12-22 17:13:07 -05:00
Daniel Salazar	ed51a042b4	telemetry: config telemetry to run by default (#2184)	2025-12-15 18:49:49 -08:00
jelveh	888fab42e1	Remove AI response normalization files	2025-12-13 00:23:35 -08:00
jelveh	9c5938e2fd	Remove comment-writer and AI METADATA comments from backend source files	2025-12-13 00:16:31 -08:00
Nariman Jelveh	8f7a735cc0	Remove dev-console-ui-utils and update related services (#2163) ... * Remove dev-console-ui-utils and update related services * Remove debug console.log statements from backend code Eliminated various leftover console.log and debug print statements across multiple backend modules and services to clean up the codebase and reduce unnecessary logging in production. * Remove unnecessary console.log statements	2025-12-12 23:46:39 -08:00
Daniel Salazar	ef69865dd1	chore: decrease uninmportant logs (#2158)	2025-12-12 18:50:01 -08:00
Nariman Jelveh	ef9f240a45	Remove terminal phoenix emulator (#2141) ... * Remove terminal and phoenix built-in apps and emulator This commit removes the terminal and phoenix built-in apps from the backend, database migrations, and permissions. It also deletes the entire emulator and phoenix/terminal app source directories, assets, and related configuration files. References to these apps in the backend module loader and router are removed, and related SQL migrations are updated to reflect their removal. * Remove emulator references from SelfHostedModule * Remove emulator integration and related references * Remove parsers and pty modules * Update package-lock.json	2025-12-11 16:53:21 -08:00
Daniel Salazar	758bef0582	Revert: commits for user metadata changes (#1887)	2025-11-02 06:09:13 -08:00
Daniel Salazar	603746951b	feat: ui for dev account + util decorators for controllers in extension (#1864) ... * fix: IPC trigger for dev account setup + util decorators for ext controllers * feat: allow extension to bypass json * fix: ts building in volatile	2025-10-31 15:48:21 -07:00
Xiaochen Cui	c93a53ead2	ci: init e2e test for browser env, tidy other tests (#1796) ... * ci: init e2e test for browser env stash changes * test: update fsentry definition, add tests stash changes * test: pass puter-js mkdir test * test: add test for puter-js move * tidy code * tidy code * doc: add docs for playwright test * recover memoryfs * test: puter-js readdir/stat * test: puter-js write * test: puter-js read * test: puter-js move_cart * test: fix failed tests on move * tests: rename files * test: puter-js copy_cart * tests: puter-js batch/delete, read config from file * ci: add vitest * ci: update names and timeout * ci: simplify playwright-test * ci: simplify api-test * move "api-tester" from tools to tests * test: update example config * test: remove folder tests/api-tester/ci * test: unify config location * test: remove unused files * ci: fix wrong config * ci: fix wrong path * test: add docs * ci: update timeout, print artifact url	2025-10-28 16:35:37 -07:00
XiaochenCui	4fdca1e47b	ci: capture the error during setup	2025-10-23 15:05:47 -04:00
Xiaochen Cui	d7a0a81991	ci: avoid potential hanging via hard limit (#1778) ... * ci: avoid potential hanging via hard limit * ci: remove build phase * ci: print tmp_password for test	2025-10-17 12:29:56 -07:00
Xiaochen Cui	89ad06afae	ci: fix failure by upgrading library (#1713)	2025-10-08 17:17:37 -07:00
KernelDeimos	62e77a15a2	conf: add block in eslint.config.js for extensions	2025-09-26 15:27:59 -04:00
KernelDeimos	fa436a7775	devex: make it impossible to commit eslint errors	2025-09-24 17:41:48 -04:00
KernelDeimos	1ea8f9ddf1	devex: performance monitor environment variable ... Instead of requiring developers to keep changes in their git index to use the performance monitor, make it configurable through the .env file.	2025-09-22 19:31:03 -04:00
KernelDeimos	f729eaa31f	fix: use dynamic import for dotenv	2025-09-22 19:30:37 -04:00
KernelDeimos	15eb44d62d	feat: add optional dotenv support ... This adds an optional import for 'dotenv'. If dotenv is installed via npm then the .env file will be loaded.	2025-09-22 19:13:05 -04:00
dependabot[bot]	8e3cc68701	build(deps): bump requests from 2.32.3 to 2.32.4 in /tools/api-tester/ci (#1598) ... Bumps [requests](https://github.com/psf/requests) from 2.32.3 to 2.32.4. - [Release notes](https://github.com/psf/requests/releases) - [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md) - [Commits](https://github.com/psf/requests/compare/v2.32.3...v2.32.4) --- updated-dependencies: - dependency-name: requests dependency-version: 2.32.4 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2025-09-21 00:49:21 -07:00
Xiaochen Cui	c8500ba1ab	test: add puterjs test to apiteste (#1590)	2025-09-19 13:27:47 -07:00
Xiaochen Cui	9d0199f858	add apitest to github actions (#1591)	2025-09-19 13:27:32 -07:00
dependabot[bot]	7e1a3c9ac7	build(deps): bump get-func-name from 2.0.0 to 2.0.2 in /tools/api-tester (#1549) ... Bumps [get-func-name](https://github.com/chaijs/get-func-name) from 2.0.0 to 2.0.2. - [Release notes](https://github.com/chaijs/get-func-name/releases) - [Commits](https://github.com/chaijs/get-func-name/commits/v2.0.2) --- updated-dependencies: - dependency-name: get-func-name dependency-version: 2.0.2 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2025-09-13 13:30:47 -07:00
dependabot[bot]	a38d8db965	build(deps): bump axios from 1.4.0 to 1.12.0 in /tools/api-tester (#1548) ... Bumps [axios](https://github.com/axios/axios) from 1.4.0 to 1.12.0. - [Release notes](https://github.com/axios/axios/releases) - [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md) - [Commits](https://github.com/axios/axios/compare/v1.4.0...v1.12.0) --- updated-dependencies: - dependency-name: axios dependency-version: 1.12.0 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2025-09-13 13:28:13 -07:00
dependabot[bot]	3c2639403c	build(deps): bump form-data from 4.0.0 to 4.0.4 in /tools/api-tester (#1547) ... Bumps [form-data](https://github.com/form-data/form-data) from 4.0.0 to 4.0.4. - [Release notes](https://github.com/form-data/form-data/releases) - [Changelog](https://github.com/form-data/form-data/blob/master/CHANGELOG.md) - [Commits](https://github.com/form-data/form-data/compare/v4.0.0...v4.0.4) --- updated-dependencies: - dependency-name: form-data dependency-version: 4.0.4 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2025-09-13 13:26:11 -07:00
KernelDeimos	6d8889e434	dev: add config.__set_config_object__()	2025-08-28 18:28:29 -04:00
Xiaochen Cui	a98cc45f22	feat: memory filesystem provider ... * Reapply "dev: memory filesystem" This reverts commit 6f3bace4c4. * fs: improve the robustess of set/get_storage api	2025-08-28 16:08:21 -04:00
XiaochenCui	bb2c51b840	captcha: add captcha widget to the signup window	2025-08-27 16:19:06 -07:00
KernelDeimos	6f3bace4c4	Revert "dev: memory filesystem" ... This reverts commit 1f6bbe1672.	2025-08-27 14:26:03 -04:00
Xiaochen Cui	1f6bbe1672	dev: memory filesystem ... * fs/memory-provider: passed all apitests * test: write benchmark * fs: add benchmark for stat-intensive scenario * apitest: update duration * fs: remove "NodeSelector", add checks to memoryfs, passed simple test * test: update apitest * debug: remove a debug stmt	2025-08-27 14:12:31 -04:00
XiaochenCui	c34bd8177c	test: fix apitest, add new unit tests and benchmarks, normalize output	2025-08-27 13:48:00 -04:00
ProgrammerIn-wonderland	58800e5d19	rebase fixes	2025-08-14 18:32:22 -04:00
KernelDeimos	65b288d58d	dev: enable DNSModule for local instances	2025-08-14 18:32:22 -04:00
XiaochenCui	27c1e62687	fs: ll_write -> provider.write	2025-07-29 19:29:35 -04:00
XiaochenCui	dea6069398	fs/stat: return_permissions -> return_shares, update tests as well	2025-07-29 13:17:55 -04:00
XiaochenCui	97eeadb3e4	fs: fix failed tests in move and stat	2025-07-29 13:17:55 -04:00
XiaochenCui	fee100dddd	fs/mkdir: add docs spec, update tests, update apitest	2025-07-22 12:46:03 -04:00
XiaochenCui	7e20039ef4	fs/mkdir: update check logic, update test cases	2025-07-22 12:46:03 -04:00
XiaochenCui	f906c1ebad	fs: adapt to different mkdir api, block write to root dir, add tests	2025-07-22 12:46:03 -04:00
XiaochenCui	0b7474340f	dev: extension prefix update, doc helper & docs update	2025-06-27 16:29:16 -07:00
jelveh	6f6bb5a484	Remove Convert, IPGeo, NewsData, Firebase, Mail, Analytics, and Weather	2025-06-21 14:57:58 -07:00
KernelDeimos	4647e2d9c0	dev: add experimental firebase authentication ... This adds an experimental custom token authentication endpoint to Puter. This is disabled unless the firebase-auth service is explicitly configured, and is not yet ready for production use.	2025-05-01 17:14:25 -04:00