Commit Graph

47 Commits

Author SHA1 Message Date
Deepak Bhatt
6983438ec2 feat: [CDE-391]:add infrastruce and orchestrator funcs (#2841)
* Merge branch 'main' of https://git0.harness.io/l7B_kbSEQD2wjrM7PShm5w/PROD/Harness_Commons/gitness into add-force-delete-job-funcs
* change name
* increase scope of delete
* change func name
* modify delete api
* Merge branch 'main' of https://git0.harness.io/l7B_kbSEQD2wjrM7PShm5w/PROD/Harness_Commons/gitness into add-force-delete-job-funcs
* add delete and handler condition
* address comment
* handle cleanup event
* update enum mapping
* find destroyed infra as well
* Merge branch 'main' of https://git0.harness.io/l7B_kbSEQD2wjrM7PShm5w/PROD/Harness_Commons/gitness into add-force-delete-job-funcs
* modify find signature
* Merge branch 'add-force-delete-job-funcs' of https://git0.harness.io/l7B_kbSEQD2wjrM7PShm5w/PROD/Harness_Commons/gitness into add-force-delete-job-funcs
* 



address feedback 2
* 



address feedback
* 



Apply suggestion from code review
* 



Apply suggestion from code review
* 



remove std out
* 



add infrastruce and orchestrator funcs
* 



add and modify infra provider methods

Add cleanupInstanceResources method
Modify Deprovision method and make it idempotent
* address feedback 2
* Merge branch 'main' of https://git0.harness.io/l7B_kbSEQD2wjrM7PShm5w/PROD/Harness_Commons/gitness into add-force-delete-job-funcs
* Merge branch 'add-force-delete-job-funcs' of https://git0.harness.io/l7B_kbSEQD2wjrM7PShm5w/PROD/Harness_Commons/gitness into add-force-delete-job-funcs
* address feedback
* Apply suggestion from code review
* Apply suggestion from code review
* remove std out
* Merge branch 'main' of https://git0.harness.io/l7B_kbSEQD2wjrM7PShm5w/PROD/Harness_Commons/gitness into add-force-delete-job-funcs
* add infrastruce and orchestrator funcs
* add and modify infra provider methods

Add cleanupInstanceResources method
Modify Deprovision method and make it idempotent
2024-10-28 05:30:14 +00:00
Ansuman Satapathy
f3016357d3 feat: [CDE-332]: added an event and method for auto-stopping (#2876)
* feat: [CDE-332]: added an event and method for auto-stopping
2024-10-28 05:06:08 +00:00
Deepak Bhatt
21bdad8ece feat: [CDE-390]:add can delete column in gitspace_config table (#2827)
* fix err msg
* update migration query
* fix typo
* feedback comments
* add can delete column in gitspace_config table
2024-10-18 08:38:27 +00:00
Ansuman Satapathy
2e2cbfa825 feat: [CDE-336]: gitspace active time, and list inactive optimize (#2766)
* feat: [CDE-336]: gitspace active time, and list inactive optimize
* feat: [CDE-336]: update heartbeat for gitspace instance
* feat: [CDE-336]: update heartbeat for gitspace instance
* feat: [CDE-336]: gitspace active time, and list inactive optimize
* feat: [CDE-336]: gitspace active time, and list inactive optimize
* feat: [CDE-336]: gitspace active time, and list inactive optimize
2024-10-03 10:32:22 +00:00
Ansuman Satapathy
a802fc8d29 feat: [CDE-336]: call gitspaces stop only when required. (#2762)
* feat: [CDE-336]: call stop only when required.
* feat: [CDE-336]: call stop only when required.
* feat: [CDE-336]: call stop only when required.
2024-10-02 08:31:28 +00:00
Dhruv Dhruv
eeb4688b59 feat: [CDE-357]: Removing error annotation from errors coming from resource limiters. (#2755)
* feat: [CDE-357]: Removing error annotation from errors coming from resource limiters.
2024-10-01 12:05:03 +00:00
Ansuman Satapathy
fdafa16687 feat: [CDE-336]: add methods to get inactive (#2754)
* feat: [CDE-336]: move cde action to service and store method for inactive.
* feat: [CDE-336]: update heartbeat for gitspace instance
* feat: [CDE-336]: update heartbeat for gitspace instance
* feat: [CDE-336]: update heartbeat for gitspace instance
* feat: [CDE-336]: update heartbeat for gitspace instance
* feat: [CDE-336]: update heartbeat for gitspace instance
2024-10-01 10:26:27 +00:00
Dhruv Dhruv
077256b69c feat: [CDE-354]: Adding gitspace usage limiter & checking usage before creation and start. (#2745)
* feat: [CDE-354]: Adding gitspace usage limiter & checking usage before creation and start.
2024-09-26 13:50:17 +00:00
Dhruv Dhruv
efcfd92517 feat: [CDE-350]: Adding columns for active time start and end in gitspace table. (#2744)
* feat: [CDE-350]: Adding columns for active time start and end in gitspace table.
2024-09-26 10:35:42 +00:00
Dhruv Dhruv
1c8a47636f fix: [CDE-316]: Increasing timeout for gitspace start/stop to 10m from 5m. (#2661)
* fix: [CDE-316]: Changing context of instance update to non-canceable context during gitspace start/stop.
* fix: [CDE-316]: Changing context of instance update to non-canceable context during gitspace start/stop.
* fix: [CDE-316]: Increasing timeout for gitspace start/stop to 10m from 5m.
2024-09-05 11:22:17 +00:00
Ansuman Satapathy
f8f54c43c7 feat: [CDE-202]: remove extra spaceID (#2641)
* feat: [CDE-202]: remove extra spaceID
* feat: [CDE-202]: remove extra spaceID
* feat: [CDE-202]: remove extra spaceID
2024-09-03 14:07:52 +00:00
Ansuman Satapathy
ec7eca7491 feat: [CDE-202]: infra provider resource cache (#2639)
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
2024-09-03 11:58:48 +00:00
Ansuman Satapathy
5cfd41ae1a feat: [CDE-202]: infra provider resource cache (#2637)
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
* feat: [CDE-202]: infra provider resource cache
2024-09-03 09:59:29 +00:00
Dhruv Dhruv
98e5f7c498 feat: [CDE-256]: Making gitspace delete async. (#2563)
* feat: [CDE-256]: Making gitspace delete async.
2024-08-22 07:36:05 +00:00
Kapil Garg
516fd5c1ca add scm provider in lookup repo (#2544)
* fix: [CDE-244]: added validation for missing URL ref
* fix: [CDE-244]: added validation for missing URL ref
* fix: [CDE-244]: added validation for missing URL ref
* treat empty input as unknown repo type
* add scm provider in lookup repo
2024-08-20 13:16:32 +00:00
Ansuman Satapathy
93af2c724e feat: [CDE-192]: show user info for gitspace listing. (#2531)
* feat: [CDE-192]: added TODO to move to user int as key
* feat: [CDE-192]: added created by col for gitspace config
* feat: [CDE-192]: added created by col for gitspace config
* feat: [CDE-192]: added created by col for gitspace config
* feat: [CDE-192]: added created by col for gitspace config
* feat: [CDE-192]: wire principal info cache
* feat: [CDE-192]: show user info for gitspace listing.
* feat: [CDE-192]: show user info for gitspace listing.
2024-08-20 09:34:10 +00:00
Ansuman Satapathy
54113d4b06 fix: [CDE-192]: correctly set resources for infraprovider config. (#2527)
* fix: [CDE-192]: db show ids in error
* fix: [CDE-192]: db show ids in error
* fix: [CDE-192]: db show ids in error
* fix: [CDE-192]: correctly set resources for infraprovider config.
2024-08-19 07:48:37 +00:00
Ansuman Satapathy
eccb57fffe fix: [CDE-192]: correctly set resources for infraprovider config. (#2524)
* fix: [CDE-192]: correctly set resources for infraprovider config.
2024-08-16 12:02:43 +00:00
Ansuman Satapathy
2f3b6a6f85 feat: [CDE-177]: Update listing page for CDE (#2506)
* feat: [CDE-207]: Fixed typecheck (#2513)

* feat: [CDE-207]: remove currentUserInfo app prop
* Merge branch 'CDE-207-FixTypeCheck' of https://git0.harness.io/l7B_kbSEQD2wjrM7PShm5w/PROD/Harness_Commons/gitness into CDE-207-FixTypeCheck
* feat: [CDE-207]: remove currentUserInfo app prop
* feat: [CDE-207]: Fixed typecheck
* feat: [CDE-207]: Fixed typecheck
* feat: [CDE-207]: Fixed typecheck
* feat: [CDE-207]: Fixed typecheck
* fix lint errors (#2520)

* add copyright header
* add copyright header
* fix lint errors
* feat: [CDE-192]: mark stuck actions as error
* feat: [CDE-192]: mark stuck actions as error
* feat: [CDE-192]: mark stuck actions as error
* feat: [CDE-192]: fix gitspace instance store
* Merge remote-tracking branch 'origin/main' into CDE-New
* add secret resolver in gitness (#2493)

* rename identifier to space identifier
* update factory method
* remove access_key from gitspace table
* add access key and type to devcontainer exec
* add migration for gitspace access key ref
* fix error message for resolver factory
* update resolver interface
* add secret resolver in gitness
* feat: [CDE-192]: correctly update date and sync update
* Merge remote-tracking branch 'origin/main' into CDE-New

# Conflicts:
#	app/api/controller/gitspace/action.go
#	app/api/controller/gitspace/delete.go
* feat: [CDE-192]: correctly update dates for updated
* feat: [CDE-192]: handle empty inputparams
* feat: [CDE-192]: handle empty inputparams
* Merge remote-tracking branch 'origin/main' into CDE-New
* Merge remote-tracking branch 'origin/main' into CDE-New
* feat: [CDE-207]: Use SCM api hook (#2499)

* feat: [CDE-207]: Updated Strings
* feat: [CDE-207]: Use SCM api hook
* feat: fixed string issue (#2476)

* feat: [CDE-211]: fixed lint issues
* feat: [CDE-211]: fixed lint issues
* feat: fixed string issue
* feat: fixed string issue (#2474)

* feat: fixed string issue
* add ssh identifier in map functions in gitness store
* add ssh fields in types
* feat: fixed GitspaceCodeRepoType in create payload
* feat: updated common hooks
* feat: update for listing
* feat: update for listing
* feat: removed cde folder
* feat: [CDE-177]: Update listing page for CDE
2024-08-16 06:46:02 +00:00
Dhruv Dhruv
dcf2068873 feat: [CDE-192]: Updating instance state synchronously when calling orchestrator's trigger flows. (#2505)
* feat: [CDE-192]: Updating instance state synchronously when calling orchestrator's trigger flows.
2024-08-14 11:57:19 +00:00
Ansuman Satapathy
f247c70311 feat: [CDE-192]: ignore deleted spaces during fetching gitspaces for account (#2465)
* feat: [CDE-192]: ignore deleted spaces during fetching gitspaces for account
2024-08-11 08:30:37 +00:00
Ansuman Satapathy
65b3cabf8f feat: [CDE-192]: validate url scheme for repos for gitspaces (#2464)
* feat: [CDE-192]: validate url scheme for repos for gitspaces
2024-08-11 07:04:10 +00:00
Ansuman Satapathy
9fc9a498e2 feat: [CDE-192]: modularize gitspace services (#2404)
* feat: [CDE-192]: resource identifier empty
* feat: [CDE-192]: resource identifier empty
* feat: [CDE-192]: resource identifier empty
* feat: [CDE-192]: resource identifier empty
* feat: [CDE-192]: address comments
* feat: [CDE-192]: split config and resource creation
* feat: [CDE-192]: split config and res creation
* feat: [CDE-192]: modularize gitspace services
2024-08-07 08:27:29 +00:00
Dhruv Dhruv
9d5071b45c feat: [CDE-203]: Making infra processing async. (#2325)
* Cleaning the flow around gitspace instance update.
* Renaming params and param schema types.
* Correcting comments.
* feat: [CDE-203]: Making infra processing async.
* feat: [CDE-203]: Making infra processing async.
* feat: [CDE-203]: Making infra processing async.
2024-08-01 10:01:31 +00:00
Shashwat Sachan
1e6330a589 feat: [CDE-195]: gitness use repo ref (#2336)
* feat: [CDE-195]: gitness use repo ref
* feat: [CDE-195]: UI changes for type and ref.
* feat: [CDE-195]: gitness use repo ref
2024-07-31 14:30:09 +00:00
Ansuman Satapathy
b6034a25aa feat: [CDE-195]: read devcontainer.json directly for gitness (#2294)
* feat: [CDE-195]: Run VS Code Web as non-root user.
* feat: [CDE-195]: read devcontainer.json directly for gitness
2024-07-26 12:44:36 +00:00
Ansuman Satapathy
0bbcc98b61 feat: [CDE-142]: extract gitspace find to its own svc (#2251)
* feat: [CDE-142]: extract gitspace find to its own svc
* feat: [CDE-142]: extract gitspace find to its own svc
* feat: [CDE-142]: extract gitspace find to its own svc
* feat: [CDE-142]: extract gitspace find to its own svc
* feat: [CDE-142]: extract gitspace find to its own svc
2024-07-19 11:43:43 +00:00
Ansuman Satapathy
b3d9a58c5c feat: [CDE-142]: specify resource for a gitspace in api call (#2249)
* feat: [CDE-142]: specify resource for a gitspace in api call
2024-07-19 05:56:35 +00:00
Dhruv Dhruv
1af6be80e9 feat: [CDE-174]: Adding logic to restart gitspaces. (#2239)
* feat: [CDE-174]: Linting
* feat: [CDE-174]: Updating the entrypoint to trap SIGTERM.
* feat: [CDE-174]: Adding logic to restart gitspaces.
2024-07-17 09:28:29 +00:00
Ansuman Satapathy
b7e720c220 feat: [CDE-142]: gitspace count query optimization (#2230)
* feat: [CDE-142]: gitspace count query optimization
* feat: [CDE-142]: gitspace count query optimization
2024-07-16 07:59:17 +00:00
Dhruv Dhruv
6e516183fd feat: [CDE-163]: Moving dir creation and deletion to infra provider. Refactoring gitspace env variables. Renaming unprovisioning to deprovisioning. (#2231)
* feat: [CDE-163]: Moving dir creation and deletion to infra provider. Refactoring gitspace env variables. Renaming unprovisioning to deprovisioning.
2024-07-16 07:59:02 +00:00
Dhruv Dhruv
afd24f911b feat: [CDE-146]: API to list all gitspaces for a user. (#2209)
* feat: [CDE-146]: Addressing review comments-
restructuring method.
* feat: [CDE-146]: API to list all gitspaces.
* feat: [CDE-146]: API to list all gitspaces.
* feat: [CDE-146]: API to list all gitspaces for a user.
2024-07-15 09:43:50 +00:00
Dhruv Dhruv
2785206535 fix: [CDE-150]: In logstream, adding locking and panic recovery around a subscriber's publish method. Adding check in the stream's publish method to not publish if the sub is closed. Closing the err channel in the log stream API handler. (#2218)
* Formatting.
* fix: [CDE-150]: In logstream, adding locking and panic recovery around a subscriber's publish method. Adding check in the stream's publish method to not publish if the sub is closed. Closing the err channel in the log stream API handler.
2024-07-15 08:10:59 +00:00
Ansuman Satapathy
56df9da6b8 fix: [CDE-141]: gitspace start stop (#2216)
* fix: [CDE-141]: gitspace start stop
* fix: [CDE-141]: gitspace start stop
* fix: [CDE-141]: gitspace start stop
2024-07-15 06:36:46 +00:00
Dhruv Dhruv
b9d3bb4d2b feat: [CDE-140]: Adding docker machine host name config to identify the public host name on which the docker host is running. Updated the docker config to read from the default docker env variables if config values are not set. Updated the events timestamp to use nanoseconds. Fixed the working directory response and cleaned the logic of how the gitspace instance url is generated. Updated the scm service to parse repo name in a provider agnostic manner. (#2201)
* feat: [CDE-140]: Fixing ProvideGitspaceContainerOrchestratorConfig.
* feat: [CDE-140]: Fixing ProvideGitspaceContainerOrchestratorConfig.
* feat: [CDE-140]: Addressing review comments.
* feat: [CDE-140]: Reverting changes done for docker config default values. Adding default value of GITNESS_GITSPACE_DEFAULT_BIND_MOUNT_SOURCE_BASE_PATH and GITNESS_DOCKER_HOST to Dockerfile. Adding new column in gitspace_events table for storing event timestamp in nanoseconds and corresponding migrations.
* Lingting.
* feat: [CDE-140]: Adding docker machine host name config to identify the public host name on which the docker host is running. Updated the docker config to read from the default docker env variables if config values are not set. Updated the events timestamp to use nanoseconds. Fixed the working directory response and cleaned the logic of how the gitspace instance url is generated. Updated the scm service to parse repo name in a provider agnostic manner.
2024-07-13 04:35:20 +00:00
Ansuman Satapathy
31ae886d00 fix: [CDE-141]: corrected infraprovider auto-creation check (#2210)
* fix: [CDE-141]: corrected infraprovider auto-creation check
2024-07-12 16:56:53 +00:00
Ansuman Satapathy
050415afdf feat: [CDE-137]: add a service layer for infraproviders, autoadd infraprovider (#2204)
* feat: [CDE-137]: add missing type.
* feat: [CDE-137]: add missing type.
* feat: [CDE-137]: add missing type.
* feat: [CDE-137]: add missing type.
* feat: [CDE-137]: add a service layer for infraproviders, autoadd infraprovider
2024-07-12 08:45:10 +00:00
Ansuman Satapathy
18226c8914 feat: [CDE-137]: check valid code repository for CDE use. (#2197)
* feat: [CDE-137]: check valid code repository for CDE use.
* feat: [CDE-137]: check valid code repository for CDE use.
* feat: [CDE-137]: check valid code repository for CDE use.
2024-07-11 05:47:29 +00:00
Johannes Batzill
76682ad400 [FIX] update unresolved comment count when suggestions are applied (#2198) 2024-07-10 23:05:22 +00:00
Dhruv Dhruv
e712903728 feat: [CDE-94]: Adding events for gitspace transitions. (#2195)
* feat: [CDE-94]: Fixing gitspace url.
* feat: [CDE-94]: Linting
* feat: [CDE-94]: Adding events for gitspace transitions.
2024-07-10 13:06:38 +00:00
Ansuman Satapathy
61f1bc55fe feat: [CDE-137]: made gitspace actions async and refactored orchestrator to handle errors correctly (#2194)
* feat: [CDE-137]: made gitspace actions async and refactored orchestrator to handle errors correctly
2024-07-10 10:44:36 +00:00
Dhruv Dhruv
87157de7fa feat: [CDE-127]: Adding changes to include logging in container orchestration's start flow. (#2192)
* feat: [CDE-96]: Renaming reusable scanner as scanner doesn't support resetting the reader. Removing closec as return param in livelog.Tail method. CLosing the handler channel when the stream is closed, this ensures the consumer to know the channel is closed. Adding a check in the render.StreamSSE to close the stream when the events channel is closed and drained.
* feat: [CDE-127]: Changes to enable log stream API for gitspaces. Adding close channel to the logstream Tail method. Changes to use a default host and working dir from config for a running gitspace instance's URL. Change to append gitspaces to the bind mount of the gitspace container in the container orchestrator instead of in the config provider.
* Initial commit
* feat: [CDE-127]: Removing streams map from StatefulLogger. Flushing the stream every time the invoking function is closed.
* feat: [CDE-127]: Removing streams map from StatefulLogger. Flushing the stream every time the invoking function is closed.
* feat: [CDE-127]: Adding flush stream logic to delete gitspace in orchestrator. Linting.
* feat: [CDE-127]: Addressing review comments.
* feat: [CDE-127]: Adding changes to make logutil.StatefulLogger a wrapper on livelog.LogStream and adding initialisation and flush functions.
* feat: [CDE-127]: Adding changes to make logutil.StatefulLogger a wrapper on livelog.LogStream and adding initialisation and flush functions.
* feat: [CDE-127]: Adding changes to include logging in container orchestration's start flow.
2024-07-10 10:25:41 +00:00
Ansuman Satapathy
6e525fca4a feat: [CDE-127]: read multi-table and multi query data in a single SQL txn (#2193)
* feat: [CDE-127]: starting and stopping states.
* feat: [CDE-127]: read multi-table and multi query data in a single SQL txn
2024-07-10 07:10:54 +00:00
Ansuman Satapathy
bf0890bd07 feat: [CDE-127]: updated gitspace delete logic, fixed listing (#2183)
* fixed events list API query
* feat: [CDE-127]: fixed events list API
* fixed events list API query
* feat: [CDE-127]: updated gitspace delete logic, fixed listing
2024-07-09 14:03:54 +00:00
Ansuman Satapathy
f78439593c gitspaces API Implementation (#2136)
* feat: [CDE-83]: fixed linting issues.
* feat: [CDE-83]: fixed linting issues.
* feat: [CDE-83]: fixed linting issues.
* feat: [CDE-83]: fixed types
* feat: [CDE-83]: fixed types
* feat: [CDE-83]: fixed types
* feat: [CDE-83]: fixed types
* feat: [CDE-83]: fixed types
* feat: [CDE-83]: fixed DB comments.
* feat: [CDE-83]: fixed DB comments.
* feat: [CDE-83]: Implemented the action API
* gitspaces API Implementation
2024-07-09 05:23:02 +00:00
Dhruv Dhruv
f3d3f7392a feat: [CDE-93]: List API to fetch gitspace events. (#2176)
* feat: [CDE-93]: Adding openapi spec.
* feat: [CDE-93]: List API to fetch gitspace events.
2024-07-08 08:29:56 +00:00
Ansuman Satapathy
728a419267 feat: [CDE-83]: Added scaffolding for APIs for gitspaces (#2173)
* feat: [CDE-83]: Added scaffolding for APIs
* feat: [CDE-83]: Added scaffolding for APIs
2024-07-05 13:03:10 +00:00