aliyun_fc

Lithops runtime for Aliyun Functions Compute

The runtime is the place where your functions are executed.

The default runtime is created the first time you execute a function. Lithops automatically detects the Python version of your environment and deploys the default runtime based on it.

Currently, Aliyun Functions Compute supports Python 3.6, and 3.9, and it provides the following default runtimes with some packages already preinstalled:

Runtime name	Python version	Packages included
lithops-default-runtime-v36	3.6	list of packages
lithops-default-runtime-v38	3.9	list of packages

Lithops default runtimes are also ship with the following packages:

pika
tblib
cloudpickle
ps-mem

To run a function with the default runtime you don't need to specify anything in the code, since everything is managed internally by Lithops:

import lithops

def my_function(x):
    return x + 7

fexec = lithops.FunctionExecutor()
fexec.call_async(my_function, 3)
result = lithops.get_result()

By default, Lithops uses 256MB as runtime memory size. However, you can change it in the config or when you obtain the executor, for example:

import lithops
pw = lithops.FunctionExecutor(runtime_memory=512)

Custom runtime

Build your own Lithops runtime for Aliyun Functions Compute

If you need some Python modules which are not included in the default runtime, it is possible to build your own Lithops runtime with all of them.

To build your own runtime, you have to collect all necessary modules in a requirements.txt file.

For example, we want to add module matplotlib to our runtime, since it is not provided in the default runtime.

First, we need to extend the default requirements.txt file provided with Lithops with all the modules we need. For our example, the requirements.txt will contain the following modules:

numpy
scikit-learn
scipy
pandas
google-cloud
google-cloud-storage
google-cloud-pubsub
certifi
chardet
docutils
httplib2
idna
jmespath
kafka-python
lxml
pika==0.13.0
python-dateutil
redis
requests
simplejson
six
urllib3
virtualenv
PyYAML
matplotlib

Then, we will build the runtime, specifying the modified requirements.txt file and a runtime name:

$ lithops runtime build -f requirements.txt my_matplotlib_runtime -b aliyun_fc

This command will built and deploy a runtime called my_matplotlib_runtime to the available Aliyun FUnctions Compute runtimes.

Finally, we can specify this new runtime when creating a Lithops Function Executor:

import lithops

def test():
    import matplotlib
    return repr(matplotlib)

lith = lithops.FunctionExecutor(runtime='my_matplotlib_runtime')
lith.call_async(test, data=())
res = lith.get_result()
print(res)

Note that both the client and the runtime must have the same python version. If you are running Lithops, for example, with Python 3.8, my_matplotlib_runtime will be a Python 3.8 runtime with the extra modules specified installed.