Python Client

Embeddings are fully optional in the python client now

Previously, if you had no embeddings available and were operating in anonymous mode, you needed to provide arbitrary values to prevent processing failures. You no longer need to provide any embedding values, even in anonymous mode.

Python client supports multiple simultaneous instances / process

Multiple instances of the aquariumlearning client package can now run simultaneously on the same host.

Python client allows editing issue state / name

Basic issue state management is now exposed in the python client's IssueManager.


Project & Dataset Management

Project / Dataset pages (+ favorites)

All projects can now be viewed on a dedicated projects page. Project settings and datasets can be viewed on each individual project page. Each dataset and inference set has a dedicated information page that has settings, metadata, and links to explore the data.
Projects Summaries
Project Details Page

Project + Dataset Metadata

You can now attach JSON formatted metadata to projects, datasets, and inference sets by going to their respective Settings pages.

Create Projects UI

You can now create a project in the web app (although you will still need to use the Python client to upload your datasets and inference sets).

Update label class map colors via UI

You can now update your label class map colors in the web app, either via the Display Settings in Explore view or through your Project Settings page.

Project preview images

You can now upload custom images as a preview image for your project so that they are visually distinct on the projects page.

Data Exploration

Left-side navbar

New vertical bar on the left side of screen to navigate between Cards Grid, Histogram, Embeddings, and Metrics. Switching between frames and crops on the Embedding view has also been moved to this sidebar as well.
The currently active view and filter on the data exploration page will now be stored in the url so that links can be shared to specific views/tabs.

Autocomplete for user metadata + issue filters

In the Data Exploration view, we now have autocomplete for categorical user metadata fields and issue names, to make it easier to find what you’re looking for.
New UI to show project -> dataset -> inference sets hierarchy on the explore/dataset pages. You can click into detailed Project, Dataset, and Inference Set pages via these breadcrumbs.


Better embedding point size defaults

Point sizes in the embeddings view now have improved size scaling based on their density.

Grid View for Embeddings

When you lasso multiple points in the Embeddings view, you can now choose to view them in a grid instead of clicking through the selected-points carousel.
Control to Open Grid View
Grid View for Embeddings

Color embeddings by custom metrics

In addition to coloring embeddings by Aquarium's computed metrics, you can now view your data colored by your own custom metrics.

Color embeddings by numeric / continuous metadata

In addition to coloring embeddings by categorical metadata, you can now view your data colored according to numerical / continuous metadata values.

Max confidence display threshold

You can adjust this threshold to visually hide hide-confidence inferences. (Note that this is used purely for display. There is a min confidence threshold that is used for metrics and confusion matrix calculations).


Issue Membership on Cards

You can now tell at-a-glance the number of issues a card is a member of, and see the full list in the expanded detailed view.

Issue Cards respect “Cards per row”

Cards-per-row as set in Display Settings now also apply to the cards in issue views.


Project-level default IOU + Conf thresholds

You can now set project-level IOU + confidence thresholds, which will be used for matching your ground truth (GT) and inferences, and for calculating metrics/confusion matrices. You can still adjust these dynamically in the Data Exploration view without affecting project defaults.

Stratified Metrics

You can now filter the metrics view based on per-label attributes. For example, if you attach an attribute called “label_size,” you can evaluate performance on just large or small labels independently. For more details, check out the docs here.

Numbers rendering on confusion matrix

You can now choose to show the absolute numbers in confusion matrix cells.

Search + Many Classes on metrics view

When your dataset has many classes (>30) it will show up as a table instead of a full confusion matrix in the metrics tab. Search bars have been added for finding the specific class you are looking for in the tables.

Project-level settings for metrics behavior on frames with no ground truth.Include_no_gt as a project-level toggle

The project settings UI now exposes an include_no_gt flag which can be updated on existing projects. This changes how Aquarium's default metrics handle frames with zero labels (the default behavior is to match pycocotools / tensorflow object detection api and ignore frames with no support).


Clientside Bucket Secrets

If your data is in a private storage bucket and you provide s3:// or gs:// data paths, you can set your corresponding AWS or GCS creds so that your assets are viewable in the app. Note that these creds remain clientside and aren’t ever exposed to Aquarium’s servers.

Inference contrast coloring mode

You can toggle “Use Inference Contrast Coloring” in display settings to view images with a high contrast coloring scheme between ground truth labels (green) and inferences (pink).

User generate-able API keys

Users can now create API keys to use with the aquariumlearning client package. Navigate to your username in the top right corner of the page, User Settings, and then Generate New API Key.

“Go to Embedding”

Allows taking currently selected cards in a non-embedding view over to the embeddings view, with the same selections preserved.

Highly visible confidence values

If you have an inference set selected in the Data Exploration view , you will now be able to see confidence numbers within the colored label “legends” in each frame.

Better sorting/searching (projects page, issue summaries)

You can more easily sort and filter though lists of projects, datasets, and issues.

Display Settings persist per project

The display settings you choose for a particular project (e.g. number of cards per row) will persist the next time you view it. Display settings are currently persisted to your local device settings.
Copy link
Python Client
Project & Dataset Management
Data Exploration