Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release dev to main branch #215

Merged
merged 17 commits into from
Nov 29, 2024
Merged

Release dev to main branch #215

merged 17 commits into from
Nov 29, 2024

Conversation

renatolfc
Copy link
Contributor

This re-releases #206 and #211 now using the release pipeline, which also updates the prod images in the Container Registry.


This PR marks the full release of FarmVibes.AI's source code with an open source license.

This PR also introduces several significant updates to the development environment, build workflows, and continuous integration processes. The most important changes include the addition of a development container configuration, updates to GitHub workflows for building and testing, and the introduction of new settings for code linting and formatting.

Development Environment Updates:

  • .devcontainer/devcontainer.json: Added a new devcontainer configuration with custom VSCode settings and extensions, Docker mounts, and environment variables.
  • .devcontainer/post-create.sh: Added a post-create script to set up the development environment, including SSH configuration, Python virtual environment setup, and installation of necessary tools and dependencies.

Build and Deployment Workflows:

Continuous Integration:

  • .github/workflows/lint-test.yml: Created a comprehensive workflow for linting, type checking, and testing the codebase across multiple packages and environments.

Code Linting and Formatting:

  • .ruff.toml: Added configuration for the ruff linter, specifying linting rules, file exclusions, and formatting preferences.

These changes aim to ensure FarmVibes.AI's longevity, to streamline the development process, ensure consistent code quality, and automate the build and deployment pipelines.

farmvibes-ai-cd and others added 15 commits July 5, 2024 23:09
Co-authored-by: Alex Crown <[email protected]>
Co-authored-by: Bruno Silva <[email protected]>
Co-authored-by: Eduardo Rodrigues <[email protected]>
Co-authored-by: Jessica Wolk <[email protected]>
Co-authored-by: Leonardo Nunes <[email protected]>
Co-authored-by: Naga Bilwanth Gangarapu <[email protected]>
Co-authored-by: Rafael Padilha <[email protected]>
Co-authored-by: Renato Luiz de Freitas Cunha <[email protected]>
Co-authored-by: Rick Gutierrez <[email protected]>
Co-authored-by: Roberto de Moura Estevão Filho <[email protected]>
Co-authored-by: Roberto Santos <[email protected]>
Co-authored-by: Sara Malvar <[email protected]>
Add workflow for linting, static type checking, and testing.
- Check each package individually
- Check ops and integration tests
- Check docstrings for `vibe_core`
This code changes are enhancements for deepmc. It help to find the
weather forecast for stations having no historical data or missing
sensor data. It will add new model created using Pytorch Graphical
Neural Network (GNN).

The code changes also having enhancements to existing deepmc scripts
that add datetime in preprocess output. It help to find data belong to
which date while performing GNN model training.

Co-authored-by: Naga Bilwanth Gangarapu <[email protected]>
Fix for #173.

Planetary Computer does not uses API key anymore. Some of our notebooks are failing because of that (and because the secret has not been added to the cluster).
… raster's boarder (#183)

In the SpaceEye workflow, if the input geometry yields a window that is
smaller than the chip size, we adjust it by splitting the difference
between the chip's and window's width (height) half way to the
right/left (top/bottom) sides of the original window. However if the
input geometry falls close to the border of the raster, we might not be
able to completely increase the window in one of the sides and end up
with a window smaller than the chip size. Because of that, the workflow
fails with "_dim_size cannot be smaller than chip_size. Please consider
reducing the step/chip size or increasing the input geometry._"

This PR updates the `_adjust_roi_window` method, so the window is
adjusted from both sides until reaching the chip size or reaching the
border of the raster.

This fixes #180.
This PR replaces the `ChipWindow` named tuple with a tuple type alias.
This fixes some serialization/deserialization errors that caused the
workflow to break.

Additionally, this PR modifies how we scale and offset the raster values
during normalization before SAM image encoder. After applying the
raster's scale and offset normalization on the RGB bands, we now clip
the values to the range [0,1] before multiplying them by 255. The lack
of clipping operation was leading to inconsistencies in the segmentation
masks outputs.
Add workflow to build and push `dev` and `main` container images.
Workflow that retags images, changes tags in the code, and opens a PR to
main

---------

Co-authored-by: Renato L. de F. Cunha <[email protected]>
Create a cluster with local images and run some tests on it
This PR adds a copyright header and license information to all FarmVibes.AI source files.
Add workflow to build and push base images, and then update tags on
relevant files.
If the user does not have [Git LFS](https://git-lfs.com/) installed when
cloning the repo, some of the large files in the repository will not be
available. This causes some workflows to break, due to reading one of
these missing files.

This PR adds Git LFS as one of the requirements for setting up the repo,
and update the Makefile to pull files when building the cluster with
local files (`make local` and `make local-worker`).

---------

Co-authored-by: Renato L. de F. Cunha <[email protected]>
…207)

This PR fixes an issue in which cluster setup would fail with an `Error:
could not download chart: invalid_reference: invalid tag` error message
when installing rabbitmq. This is related to [this issue in bitnami
repo](bitnami/charts#30582), and fixes issue
#203.

This PR also updates the redis and rabbitmq image tags to the latest
versions to ensure compatibility with the latest dependencies and
security patches.
@renatolfc renatolfc merged commit a9e999f into main Nov 29, 2024
9 checks passed
@renatolfc renatolfc deleted the release-main-12088305617 branch December 2, 2024 17:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants