Stream: friends

Topic: 62: Kaizen! Just do it


view this post on Zulip Jerod Santo (Sep 20 2024 at 18:36):

:link: https://changelog.com/friends/62

Gerhard Lazu joins us for Kaizen 16! Our Pipe Dream™️ is becoming a reality, our custom feeds are shipping, our deploys are rolling out faster & our tooling is getting `just` right.

view this post on Zulip Matt Johnson (Sep 21 2024 at 00:17):

Relating to pipedream / pipe-reality / change-pipe / pipe-log / pipely...
I did a little experimenting with purging requests and trying to get some thoughts together on how to purge all instances if there were multiple Varnish instances.

https://github.com/mttjohnson/changelog.com/blob/james-and-gerhard-build-jerods-pipedream-adam-helps/fly.io/cdn-2024-01-26/default.vcl#L93
https://github.com/mttjohnson/changelog.com/blob/james-and-gerhard-build-jerods-pipedream-adam-helps/fly.io/cdn-2024-01-26/VARNISH_TESTING.md#purging-all-varnish-instances
https://github.com/mttjohnson/changelog.com/blob/james-and-gerhard-build-jerods-pipedream-adam-helps/fly.io/cdn-2024-01-26/VARNISH_TESTING.md#acls
https://github.com/mttjohnson/changelog.com/blob/james-and-gerhard-build-jerods-pipedream-adam-helps/fly.io/cdn-2024-01-26/VARNISH_TESTING.md#testing-the-local-varnish-container

I like the idea of a test harness, nice job @Jerod Santo ...
https://github.com/thechangelog/pipedream/issues/2

Changelog is news and podcast for developers. This is our open source platform. - mttjohnson/changelog.com
Changelog is news and podcast for developers. This is our open source platform. - mttjohnson/changelog.com
Changelog is news and podcast for developers. This is our open source platform. - mttjohnson/changelog.com
Changelog is news and podcast for developers. This is our open source platform. - mttjohnson/changelog.com
On Kaizen 16 I said: I'd love be able to develop against this with confidence, especially once we start adding those edge redirects and things... And Gerhard said: Create an issue... open source fo...

view this post on Zulip Matt Johnson (Sep 21 2024 at 00:39):

Custom Feeds:
I remember the week that the custom feeds were hinted at in a New episode on a Monday and then that Friday Supercast broke and a whole bunch of ++ members including myself switched over to the custom feeds, and at that point I dropped the Supercast feed going all in on the custom feed.

It sounds like @Adam Stacoviak and @Gerhard need to adopt these new "features" earlier so you don't face regression bugs. :laughing:

:point_right: :nerd: :point_left: I'm a nerd... I just logged into changelog.com from my phone :-)

Weekly shows about software development, developer culture, open source, building startups, artificial intelligence, brain science, and the people involved.

view this post on Zulip Matt Johnson (Sep 21 2024 at 01:30):

I'm anxious to see any videos from SREday!

view this post on Zulip Matt Johnson (Sep 21 2024 at 03:47):

just -n install and just install worked pretty cool.
I then ran just contribute ...and wow yeah, that does a lot!

It worked though:
CleanShot-2024-09-20-at-22.44.442x.png

view this post on Zulip Owen Valentine (Sep 21 2024 at 13:04):

pipedre.am :eyes:

view this post on Zulip Jerod Santo (Sep 21 2024 at 13:06):

Matt Johnson said:

just -n install and just install worked pretty cool.
I then ran just contribute ...and wow yeah, that does a lot!

It worked though:

That's awesome!

view this post on Zulip Jerod Santo (Sep 21 2024 at 13:08):

Rolled this feature out yesterday.

CleanShot-2024-09-21-at-08.07.222x.png
Any other apps we should add to the list (and what is their URI format?)

view this post on Zulip Owen Valentine (Sep 22 2024 at 07:08):

Jerod Santo said:

Matt Johnson said:

just -n install and just install worked pretty cool.
I then ran just contribute ...and wow yeah, that does a lot!

It worked though:

That's awesome!

AntennaPod please: https://antennapod.org/documentation/podcasters-hosters/add-on-antennapod :D

Create an ‘Open in AntennaPod’ link

view this post on Zulip Anders Johansson (Sep 22 2024 at 14:19):

The sound of Gerhards genuine happiness when he found out that you have started using zulip made my run today! Keep up the good work!

view this post on Zulip Luke Palnau (Sep 24 2024 at 16:29):

@Gerhard So interesting hearing about the experimentation with the tool just, I had added just to a couple of work repos as a simpler make. I've been considering how to migrate our deployment pipeline away from bash scripts to something like dagger/python, hoping it would be easier to maintain across a team of typescript/python engineers. I hadn't considered performance loss, just focused on easier maintainability.

I've been testing act for local GH actions development, I'm interested to look at the GH actions local runs described in this episode, is this the right PR to look at?

First run, empty cache (first time penalty) Second run, primed cache This replaces our Dagger on Fly.io setup with Dagger on Namespace.so We still keep K8s to see if we can improve on Namesp...

view this post on Zulip Gerhard (Dec 05 2024 at 10:38):

Hi @Luke Palnau :wave:

Migrating from bash scripts to a Dagger Python module makes a lot of sense! The most important distinction in that world is that the entire context starts in a container, and you are guaranteed version correctness (especially if you pin container images down to the sha256, which I highly recommend).

In terms of performance loss, this typically happens when you get QEMU involved (if building cross-platform images) or when the container runtime is not platform native (e.g. running Docker Desktop on macOS). It can also happen when you are shuttling a lot of context (source code & artefacts) to and back from Dagger. This usually happens with large repositories which have simplistic context filtering rules, meaning that the entire context gets uploaded on every call.

This is a good starting point: https://docs.dagger.io/adopting

https://github.com/thechangelog/changelog.com/pull/522 is when we switched from running Dagger on Fly.io to Namespace.so. This is using a really old version of Dagger which didn't have support for modules & functions.

As a generic, big picture, from scratch approach, my first thought is https://www.youtube.com/watch?v=g2E86Ke_RME

What is the outcome that you are trying to achieve? Based on your answer, I can recommend the simplest way of getting there.

view this post on Zulip Gerhard (Dec 05 2024 at 10:41):

Anders Johansson said:

The sound of Gerhards genuine happiness when he found out that you have started using zulip made my run today! Keep up the good work!

From where I'm standing, we are all in on Zulip! :nerd:

Using it on Arc makes it feel like a native app. Here's a meta preview:
image.png


Last updated: Jan 06 2025 at 02:39 UTC