Oskar Dudycz

Pragmatycznie o programowaniu

Let's build event store in one hour!

2023-01-08 oskar dudyczEvent Sourcing

Last year, I completed two items from my speaker bucket list NDC Oslo and Domain-Driven Design Europe. I’m proud and happy, as those conferences were a huge inspirations for me.

At NDC Oslo, I showed one of my favourite talks: “Let’s build event store in one hour!“. Why do I like it so much? It’s a fun mixture of live coding and theory explanation. At least for me.

It’s technically hard talk to deliver as I need to coordinate speaking, live coding and not boring people with technical details. It’s kinda speed run for me. But when precisely delivered, I think that’s fun talk to watch. Check it on your own!

This talk does not intend to persuade you to write your own event store. There are already mature solutions like Marten, EventStoreDB, Axon.

The intention is to dive a bit deeper, showing that Event Sourcing and event stores can be treated as boring technology in the good sense. It’s about showing that it’s not a hyped buzzword but a tool that can bring real benefits and give you the guarantees you need.

I like to see how people’s eyes get bigger when they see the SQL stored procedure. I also like when they’re surprised that I’m not using any messaging tooling or regular database transactions. Most people also don’t expect that read models can also be updated synchronously without having eventual consistency.

So it’s more about myths busting and explaining Event Sourcing pattern in a nutshell.

What are the requirements, then? In my opinion, at least:

  • appending event at the end of the stream,
  • reading all events from the stream,
  • a guarantee of the ordering within the stream,
  • being able to read your writes,
  • strong-consistent, atomic writes and optimistic concurrency.

The 2nd tier of event stores features (so great to have but not must-haves):

  • being able to subscribe to notifications about newly appended events (best if it’s push-based)
  • global ordering,
  • built-in projections,
  • streams archiving.

Check more on those considerations in the:

I also have something special for you, a self-paced kit on building event store on top of Relational Database using Postgres as an example. It starts with the tables set up and goes through appending events, aggregations, handling business logic, time travelling, projections, and snapshots.

I think that’s a fun way to learn Event Sourcing, check versions for:

Once you’re done, please don’t use it on production; rather, use some mature solutions. Maintaining it won’t be sustainable if it’s not your core business.

Event stores are databases. Just like you won’t say “hey, let’s build the relational database for our project”, you should not do that with an event store.

Still, it’s a lot of fun, nothing too time-consuming to build a simple one and an excellent exercise in understanding how Event Sourcing works.

Not convinced? Read then why you can think about event stores as key-value stores, and why that matters.

Cheers!

Oskar

p.s. Ukraine is still under brutal Russian invasion. A lot of Ukrainian people are hurt, without shelter and need help. You can help in various ways, for instance, directly helping refugees, spreading awareness, putting pressure on your local government or companies. You can also support Ukraine by donating e.g. to Red Cross, Ukraine humanitarian organisation or donate Ambulances for Ukraine.

👋 If you found this article helpful and want to get notification about the next one, subscribe to Architecture Weekly.

✉️ Join over 11500 subscribers, get the best resources to boost your skills, and stay updated with Software Architecture trends!

Loading...
Event-Driven by Oskar Dudycz

cover

Through my window, I see the result of good plans but poor execution. Opposite my flat, there is a partially completed construction place. Buildings were supposed to be eye-catching Mediterranean style apartments. Delivery date? Two years ago. Actual? More and more unknown.

Some time ago, I heard that using Event Sourcing makes creating Event-Driven Architecture easier. The arguments were correct, that if we’re already publishing events to trigger business workflows, then at some point, we may want to also store events to not lose information. Agreed. However, I also heard that keeping the state as events will simplify things. We’ll have a source of truth with a record of the system behaviour. This will allow, e.g. to confront the results of the operations with the recorded state. I’d agree with that, with one distinction. It’s easier as long as you already know Event Sourcing.

Many people in the DDD community claim that the essential is to properly break down the system into autonomous parts called bounded contexts. Once we have it, the rest is secondary and will sort itself out. For sure.

Many seasoned programmers speak similarly about new technologies. They claim that they can translate past experience into new technologies. That’s true that by analogy, they can catch the big picture quicker. But isn’t it a bold assumption to say that Win.Forms specialist will learn Angular quickly?

The end result may differ a lot from the initial ideas. I saw the plan of those buildings next to me. Now I can see the effects of the execution. Or actually, the lack.

I believe that we should carefully acknowledge not only the point of view of our authorities but also their seating point. If we want to find out how to form a wall, do we ask an architect or a foreman? An architect may know the theory, but the practice is what we’re looking for. On the other hand, if you want to know where to put the wall, you prefer the architect to do measurements. At least if you don’t want to have the roof falling to your head.

After I had torn a ligament in my knee, I went to two qualified orthopedists. One said I should have surgery and do a reconstruction. The second stated that there is no need for that; rehabilitation should be enough. Guess which one had a specialization in surgery and which in rehabilitation?

People usually give us advice from the point where they’re currently standing. They are entitled to a biased view. An architect who rarely does programming will tend to downplay the value of implementation and tactical patterns. Midlevel developers will focus on technicalities instead of the global system impact. The team manager or consultant will emphasize the importance of soft skills (or esoteric techniques known only to them).

The truth is that we need all of them. The excellent plan will fall on the bad execution. The best execution for the wrong case will be just a waste of time. We should carefully evaluate the advice considering what we need and what an expert can give us.

Therefore, when we’re reading an article, watching a talk, let’s also pay attention to the place where the person is standing. The perspective from there may be much different from where we are right now. That can be good, as it may push us in the right direction. But it may also be misleading, as we accidentally take biases of this person without understanding the tradeoffs. Personally, I prefer to follow not only people from pedestal but also those that are closer to my position. A bit further in the journey, but not too far. That helps me to calibrate my view as those people are more relative to my daily struggles.

Polish historical leader Józef Piłsudzki reportedly used to say: “Right is like an ass, everyone has its own”.

Cheers!

Oskar