[Bigbang-dev] Apache Superset for dashboarding?

[Sebastian Benthall]

Interesting point.

I'm convinced of a few interrelated points by the discussions surrounding
the hackathon.

- There are broad research Infrastructure needs of the RASP RG which
include:
   - a database
   - data processing scripts
   - data ingress methods, as well as fixtures for established data (such
as expensive annotations)
   - an API to access the database
   - one or more user interfaces visualizing data from the database

The mature version of "the dashboard" looks something like this.

 - BigBang has been slowly growing in this direction, but is far from it.
For example, we currently store data in flat files rather than use a
database.

 - The current dashboard implementation is a great prototype for future
work. It would be great to have something demo-able, and we are getting
there fast.

In short, I think it's useful to distinguish between v0.1 features and v1.0
features.

Apache Superset, were we to use it, would be a 1.0 feature. We are still
working on a 0.1 demo version.

On Sun, Mar 26, 2023, 8:49 PM Mridul Seth <seth.mridul at gmail.com> wrote:

> Hmm, from my preliminary reading it seems like superset needs a SQL DB
> running in the background? Or am I mistaken?
>
> On Sat, Mar 25, 2023, at 09:30, Sebastian Benthall wrote:
>
> Our current dashboard implementation uses Bokeh so it naturally extends
> our Scipy-using notebooks. This is a good way to prototype!
>
> Priyanka is enthusiastic about Apache Superset as a dashboarding tool,
> which could have other features that are useful:
> https://superset.apache.org/
>
> I haven't put much thought into dashboarding technologies myself, but as
> the vision for the dashboard develops (Niels is workshopping the design
> with a UX designer as I write this), we may want to consider alternative
> tools and architectures that are fit to our design needs.
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ghserv.net/pipermail/bigbang-dev/attachments/20230327/e724b3df/attachment.htm>