Kubernetes integration

[iangregsondev]

Would be really nice if we could deploy our applications to Docker Hub - for example :-)

Deployments to cloud providers are great but ability to deploy to docker hub (or even a private docker registry) - would open up a lot.

[MitkoTschimev]

The first thing should be possible as far as I can see with a quick review:
https://www.pulumi.com/docs/reference/pkg/nodejs/pulumi/docker/

The second point I would like to separate from this Feature Request. @iangregsondev can you do this, please?

[iangregsondev]

@MitkoTschimev Separate the feature request with regards to the github ?

Would you like me to submit a separate issue ?

[iangregsondev]

@MitkoTschimev I have separated the issue we were speaking about - I think.

Let me know if that is what you was referring to ?

#50

I have also gone ahead an updated the title of the issue to exclude the github reference.

[iangregsondev]

The first thing should be possible as far as I can see with a quick review:
https://www.pulumi.com/docs/reference/pkg/nodejs/pulumi/docker/

The second point I would like to separate from this Feature Request. @iangregsondev can you do this, please?

I presume the above library can just read in a dockerfile ?

https://www.pulumi.com/docs/reference/pkg/nodejs/pulumi/docker/#DockerBuild-dockerfile

I mean it looks like the library actually takes care of building a dockerfile via code as well. I think it would be also to just read in a dockerfile and publish it ?

[MitkoTschimev]

Yes, we have to define what is the scope of the issue now and how can an integration look like?

What do we expect at the end?
Let's make a small brainstorming:

So nx-deploy-it will generate infrastructure to:

• build a docker image
• deploy it to the docker hub
  • allow custom docker registry

as example:

• apps
  • my-nest-app
    • infrastructure
      • Dockerfile (build the image)
      • index.ts
    • src
    • ...

The next thing is to deploy it somehow somewhere otherwise it doesn't fit within this plugin. So what I could imaging is to provide the possibility additionally to run it as ESC on Fargate as an example or the other server instances on Azure or GCP.
The plugin supports still the main idea ;)
As 4th option of course a custom deployment by my self (using the docker image from the hub)

[iangregsondev]

I like the idea of the folder structure. Maybe this could be configurable as to the location of the Dockerfile.

It would also be beneficial to pass in environment variables for use while building the Dockerfile.

So these could be standard environment variables and also the ability to load via a .env file - docker has some information here https://docs.docker.com/compose/env-file/

With regards to deployment, I certainly think its beneficial to be able to deploy it to a cloud service - of course.

Although I do really see that deploying this to docker hub is a deployment.

Certainly in my case anyway, I am currently hosting inside a docker in Digital Ocean - but I have a service running to redeploy my docker services when the image changes in a registry.

There are 2 services that already support this, one that works on a pure docker container and another that works with docker swarm. I will paste them here for clarity

https://github.com/containrrr/watchtower

https://github.com/djmaze/shepherd

I think it would beneficial not allow a further deploy to a cloud service as you explained BUT i also think then the deployment could stop there - with the deployment to a registry.

I really do think that uploading the image to either docker hub or a private registry - is a real deployment.

I think some docker installations are locked down and probably not accessible from outside of the installation to perform the deployment.

For example, my production build is in Digital Ocean which of course has a public IP but I also run 2 development environments where the docker environment is NOT exposed externally - docker machine is used on a local IP.

I think it would be nice to offer a 2 stage deploy -
a. To a docker registry
b. To a cloud service using the image

It would be nice if both were opt in

[MitkoTschimev]

So this sounds really interesting and we will try to implement this as soon as possible ;)
Then I see 2 steps here to fulfill and keep the plugin as clean as possible.

This Issue should solve to provide the application as docker image to a registry.
I created an additional issue #52 and hope you can help us there to integrate a 4th provider to nx-deploy-it ;) because we don't have so much experience with digital ocean

[MitkoTschimev]

Someone has already created a plugin for docker creation:

https://github.com/gperdomor/nx-tools/tree/master/libs/nx-docker

maybe this could be reused here?

[kauppfbi]

Hi @MitkoTschimev and @iangregsondev,

I really like the idea to integrate Docker as well. Last year I already did something pretty similar.
https://github.com/kauppfbi/ngx-deploy-docker

I am currently about to migrate it to a nx plugin (still within a private repo), but then I saw, that you are interested in it as well.

What do you think about a collaboration & integration in your repo? You can get in touch with me on twitter: https://twitter.com/kauppfbi

[MitkoTschimev]

Sure we can collaborate together here but I would use directly pulumi to create the docker images. They have already a package for this and than it’s in harmony with the whole other infrastructure as code and Easy to use with the cloud providers in combination for deployment.

[iangregsondev]

@MitkoTschimev Very nice - didn't realise that nx-docker existed. Looks great.

@kauppfbi I like what I see but an NX plugin would be great but as you say collaborating together which probably would be a really good way of obtaining the best possible implementation and plugins!

Nice.

[kauppfbi]

Hi,

Glad you're thinking the same.

I agree, using pulumi is better in this case. I just didn't know about it.

Can we have a short alignment to discuss about design, features and scope?

[MitkoTschimev]

Sure just my first thoughts when I dig into deeper:
(Hope you are a bit familiar with nx-deploy-it)

Imagine this flow:

1. Choose provider
2. Users can choose between serverless or Kubernetes (I want directly to provide Kubernetes support) for backend applications.
3. Is choosing Kubernetes than he would be asked if he wants to use a shared master
   -> Yes a lib in NX would be created with the IaC for the master cluster
   -> No a master would be created inside the app infrastructure folder
4. Asking for the container registry related to the provider
   -> User types one -> this one will be used to push the new images
   -> User hits enter without providing will create a container registry in the same lib folder (registry container should be reused by all apps in the workspace)
5. Creating IaC for the backend app (k8s service type load balancer) and pod with the image
6. Create Dockerfile inside the infrastructure

nx run my-app:deploy
-> and here we go 😀