Skip to content

Latest commit

 

History

History
380 lines (379 loc) · 15.8 KB

File metadata and controls

380 lines (379 loc) · 15.8 KB
layout special

CloudButton Project Review


Videos and presentations

Video Slides
CloudButton Project Overview and Architecture (WP2)
Metabolomics Use Case
Geospatial Use Case
Genomics Use Case
WP3: Serverless Compute Engine for Big Data
WP4: Support for Mutable Shared Data in Serverless Computing
WP5: CloudButton Toolkit
Dissemination and Communication TBD

Additional materials

Video Slides
Auto-scaling in-memory computing (RHAT)
Serverless SLAs & Testbed (ATOS)
Argo Serverless Orchestration (IBM)
Triggerflow (URV)

Deliverables

PDF
D1.1 Public Project Website
D2.1 Experiments and Initial Specifications
D2.2 Data Management Plan, 1st version
D2.3 CloudButton Architecture Specs and Early Prototypes
D2.4 Data Management Plan, 2nd Version
D3.1 Initial specs of the Serverless Compute and Execution Engine
D3.2 Serverless Compute Engine Design and Prototypes
D4.1 Initial prototype for stateful serverless computation
D4.2 Specification and partial support for degradable objects
D5.1 CloudButton Initial API Definition
D5.2 CloudButton Prototype of Abstractions, Fault-tolerance and Porting Tools
D6.1 Communication plan
D6.2 Communication report

Software results

Title Description Repository
PyWren for IBM Cloud A framework to massively scale the execution of Python code and its dependencies on IBM Cloud Functions.
Crucial A system to program highly-concurrent stateful applications on serverless architectures. It keeps a simple programming model and allows to port effortlessly multi-threaded algorithms to FaaS.
Faasm A high-performance stateful serverless runtime that provides multi-tenant isolation, yet allows functions to share regions of memory.
Triggerflow An scalable, extensible and serverless platform for event-based orchestration of serverless workflows.
CloudButton Toolkit examples Notebook examples for the CloudButton Toolkit: Moments in time, Mandelbrot set computation, Pi estimation using the Monte Carlo method.
CloudButton Apache Airflow plugin Apache Airflow Plugin that implements new operators to easily deploy serverless functions tasks on IBM Cloud Functions.
Serverless Elastic Exploration of Unbalanced Algorithms Implementation of unbalanced algorithms like the Unbalanced Tree Search benchmark over serverless functions.
Serverless port of SMILE Port of a subset of SMILE machine learning library to Crucial.
Infinispan Openshift operator An OpenShift operator to run and rule Infinispan.
Python Client for Infinispan A Python protoclient for connecting to an Infinispan server via Hotrod.
Replica Exchange with Serverless Reimplementation of Replica Exchange with Workqueue making use of different Serverless frameworks such as IBM-PyWren and Multiprocessing API.
Metabolomics use case - Experiment 1 Demonstrates running through the whole Serverless metabolite annotation pipeline with a typical dataset, downloading the results and comparing them against the Serverful implementation of METASPACE.
Metabolomics use case - Experiment 2 An example of running the pipeline against a smaller set of molecules, to demonstrate the potential of Serverless to provide low-latency access to computing resources.
Metabolomics use case - Experiment 3 A stress test that runs the Serverless metabolite annotation pipeline with a large dataset and many molecular databases.
Geospatial use case - Experiment 1 and 2 High-resolution hybrid land-cover mapping and 3D fuel mapping for forest risk assessment
Geospatial use case - Experiment 3 Water consumption estimation
CloudButton-SLA SLA system, inspired by the WS-Agreement standard, that uses Knative Observability Plugin monitoring data to supervise Knative running pods in order to identify candidate performance improvements and/or problems.