The Gang Solves the Gas CrisisJonathan Paprocki ~datnut-pollen
Anybody who has used Ethereum smart contracts recently is aware that it has gotten expensive. There are a large quantity of complicated and clever techniques each with their own trade-offs that are collectively referred to as "layer 2 solutions" (see further resources for more information about these). This is in contrast to the base computational layer of Ethereum called "layer 1", which is what constitutes most Ethereum usage and where Urbit ID’s smart contracts currently exist.
Tlon has always covered gas costs for Urbit ID up to a set limit, and this was easy a couple of years ago when the cost of transactions required to get a planet up and running came out to less than a dollar. Unfortunately the ongoing Ethereum gas crisis, along with the rising price of Ethereum itself, has made this impossible. We’ve seen gas costs to set up a planet as high as several hundred US dollars at time of writing!
In response to the gas crisis, Tlon has spent the last several months developing a simple, in-house layer 2 solution which we anticipate will reduce typical gas costs by 65x or more.
This post is primarily a short non-technical explainer of the end-user experience of our solution aimed at planet and star owners and those in the market for one, as well as a status update on where we're at in development. At the end we give some minimal technical details and resources to help you dig deeper should you wish. This is also primarily aimed at those who currently self-host or plan to self-host their urbit. For anybody utilizing a hosted service, this matter will all be handled by your provider. There is a separate section addressed specifically at star owners, and another section for those who wish to set up their urbit to accept and submit layer 2 transactions. We’d like to emphasize that this system is 100% opt-in—if you are satisfied with the current experience of Urbit ID, then nothing changes for you whatsoever.
Perhaps the most pressing question held by anybody reading this is—when will it be ready? It's not reasonable to give a timeline on difficult engineering work, but rest assured that completing this upgrade is a top priority. Much of the back-end is approaching completion, and we are confident in a release before the end of Q3 and hopefully much sooner.
Our layer 2 solution, designed primarily by Tlon lead engineer
is known as "naive rollups" and we will be using this term interchangeably with
"layer 2"—though it is important to note that there are many layer 2 solutions
utilized by projects other than Urbit. As we're avoiding technicality here, we’re focusing primarily on the advantages and disadvantages of utilizing our layer 2 solution, and how that affects the management of your ship.
Very briefly, a rollup is a way to combine many transactions into one, and we are building infrastructure so that any Urbit ship may be utilized as a "roller". A roller will collect layer 2 Urbit ID transactions, confirm their validity, and post them to the Ethereum blockchain. More detail is given at the end. Anybody may set up a ship to act as a roller. Tlon will be launching our own publicly accessible roller, but as Urbit is a decentralized network, by no means will we have a monopoly.
Pros and cons
The primary advantage to using naive rollups is that the gas cost for Urbit ID-related actions will be dramatically reduced. It will be reduced sufficiently that we expect that a few transactions per ship per week (plenty for ordinary usage) submitted to Tlon's roller will not cost the end user anything. There are no gas costs associated with submitting a layer 2 transaction to a roller, and Tlon will bear the gas cost of posting the results to the blockchain. That means that the cost you see for a planet on a market that utilizes Tlon's roller ought to be the final cost.
There are a few trade-offs for this, but none of them really sacrifice the core value propositions of Urbit ID.
The most substantial one is that ships on layer 2 are essentially completely isolated from the rest of the Ethereum ecosystem. They can no longer interact with smart contracts designed to work with Urbit ID or non-fungible tokens (which are how Urbit IDs are represented) in general. It is also not possible to write new Ethereum smart contracts that work with layer 2 ships.
Compounding that factor, the journey to layer 2 is one-way only—at least for now. There are theoretical ways a ship may be moved back to layer 1, but they do not yet exist, and we cannot promise that such a thing will be available in a timely manner. Anybody moving a ship to layer 2, or buying a ship on layer 2, should assume that they will remain on layer 2 for the foreseeable future. We do not expect this to be permanent, but it is perhaps the most significant drawback for the time being.
Another one is that transactions may no longer be "instant". Effectively, this was already the case on layer 1—unless you paid a lot of gas, you could wait hours or even days for your transaction to clear. But the way we are saving on gas is essentially by "bundling" or "rolling up" many transactions into one, and submitting them as a single transaction. The more transactions in the rollup, the better the savings. This bundling is not the only factor at play here though—costs are reduced other ways, but this is a technical detail discussed later in this post. It is possible to use layer 2 to submit single transactions (and this will still save on gas costs!), so utilization of layer 2 should not incur any delay over layer 1 when utilized in this fashion.
Tlon has not finalized the details on how our roller will work, but it will probably involve waiting until a sufficient backlog of transactions have been submitted to make it economical to bundle them up, or just submitting every set time period, whichever arrives first. We do not see this as a big issue—we view Urbit ID as "digital land", and a few hours to acquire land, or waiting for your new personal computer to be delivered, is still lightning fast in comparison to the real world. We also have ideas on methods that will allow you to get on the network before the transfer has been confirmed, but that is outside of the scope of this article.
Our layer 2 preserves the main value proposition of Urbit ID, which is that your ship
belongs to you forever, and that this is assured by very strong cryptographic methods and
game-theoretic arguments comparable to the ones that exist on layer 1. We
consider this principle to be uncompromisable, and maintaining ultimate
sovereignty over your ship was totally central in choosing our solution.
We summarize the new security model below, and
goes into greater detail in the resources.
Changes to User Experience
The primary way one manages their Urbit ID, namely performing tasks such as transferring ships, setting networking keys, or setting proxies, is with a web interface called Bridge found at bridge.urbit.org. If you already own a planet, you've probably used Bridge before - perhaps only a single time.
Bridge will be getting a facelift to enable easy interfacing with layer 2, including loud warnings about what is being gained and lost by doing so. From here you will be able to transfer your ship to layer 2, and once there, perform all the usual actions you can on layer 1.
The main difference for layer 2 transactions on Bridge will be the additional choice of a roller to submit transactions to. Tlon's will be free for ordinary, non-time-sensitive usage. You could use your own ship for a fast single transaction for a little more gas. We expect that planet markets and stars may wish to set up their own rollers as well.
Every planet has a sponsor star, which distributes OTA updates to their sponsored planets and assists with peer discovery. Both layer 1 and layer 2 planets will be able to be sponsored by either layer 1 or layer 2 stars, meaning that nothing will change in terms of how sponsorship works.
When you buy a ship, any reputable seller will inform you whether or not it is on layer 1 or layer 2. Anyone running an urbit will be able to verify this information, and we expect for tools to exist to make this information publicly available (see this grant).
And that's it! If you'd like to know how things will be changing for stars, what goes into setting up a roller, and additional technical details, read on.
Changes to stars
Both planets and stars will be able to move to layer 2. Galaxies must remain on layer 1 for technical reasons, and moons and comets never interacted with Ethereum anyways, so they are completely out of the picture.
Stars will be able to remain on layer 1 with no action required. For star owners that wish to take advantage of the cheaper gas costs, there are two possible modes: ownership of the star on layer 2, or setting the spawn proxy to layer 2 with ownership remaining on layer 1.
The first mode—a star which is owned on layer 2—has the same advantages and disadvantages as a layer 2 planet. Planets spawned by a layer 2 star will also necessarily be on layer 2 - there is no way to spawn a layer 1 planet from a layer 2 star, though any planets which were spawned on layer 1 before the star migrated to layer 2 will remain on layer 1.
The second mode—ownership on layer 1, with spawn proxy on layer 2—is only slightly more complicated. Such a star will change its networking keys, transfer between wallets, and set its management proxy all on layer 1, with the corresponding higher gas cost. However, it will be able to spawn planets on layer 2—and only on layer 2—with the corresponding layer 2 tradeoffs. Like moving ownership to layer 2, this will be a one-way journey for now. Planets spawned before moving the spawn proxy to layer 2 will remain on layer 1, but from then on, all planets spawned by that star will live on layer 2. Finally, stars in this second mode may transition to the first mode, but not vice versa.
Creating a roller
Rollers are urbit nodes which users submit transactions to to be "rolled up" into a bundle to be submitted to the Ethereum blockchain. The business logic for a roller runs on the urbit node itself. Thus, anybody with an urbit ship may set it up to act as a roller. While the details of how rollers work are still being hammered out, one should expect that one can either set transactions to be submitted at regular intervals, once a sufficient number of transactions have been received (as more transactions means greater savings), manually, or some combination of the above.
Tlon plans to release documentation on how to set up your own roller concurrently with the release of our layer 2 solution.
Malicious rollers could potentially exist, but the worst they ought to be able to do is simply not submit your transaction. The security factors for rollers are briefly addressed below, and elaborated upon in the resources, but you can expect full technical documentation on these factors to be included in the roller documentation.
Changes to Azimuth
Azimuth is the set of Ethereum smart contracts governing Urbit ID. They will require a few changes to accommodate the new system. Some of this has been implicit above, but to be clear, we will only be making a couple minor alterations:
- Once a star's spawn proxy is set to the layer 2 address, it can't be switched back, and they can no longer spawn layer 1 planets.
- Galaxies and their proxies cannot be deposited to layer 2. Some other minor details are yet to be worked out, but again, nothing will change for those who wish to remain on layer 1.
What's really going on behind the scenes here? Briefly, only the data of the Urbit ID transactions will be posted on-chain, while computation and state storage will now happen on your ship.
In layer 1, the Ethereum Virtual Machine (EVM) guarantees the validity of state transitions, while for layer 2 transactions, each Urbit node guarantees the validity of the state transitions.
Changes to the state of Urbit ID on layer 1 works as follows:
- A transaction is posted to the Ethereum blockchain.
- The EVM calculates the resulting state transition and checks its validity, then updates the state.
- Your urbit downloads the new state from an Ethereum node.
- Your urbit makes the final decision on whether the new state is valid.
In practice, the fourth step is never used in layer 1. The primary change to our security model is that we are cutting out step 2 and beefing up step 4. Your ship will now perform validation of the transactions posted to the Ethereum blockchain, rather than the EVM.
Since Urbit OS is deterministic, and Hoon has some nice formal properties, it turns out to be a great language for writing smart contracts. Thus we are effectively swapping the Ethereum smart contract with a “Hoon smart contract” run locally on your ship.
We want to keep this post brief and non-technical, so that's all we'll say about
it for now. To find out more, you have a few directions to go on. We held a
Developer Call where
~wicdev-wisryt outlines the design in much more technical detail, and also
explains why we decided to utilize our own design rather than other known layer
2 solutions such as Optimistic
etc, or other blockchains. He also plans to do a more technical walkthrough video sometime before release. For those who would rather read, see
~wicdev-wisryt's RFC: Naive rollup for cheaper Urbit ID
post on the
urbit-dev mailing list. Lastly, the primary working branch on
Github for the Urbit side of naive rollups is
here, though it is not the
only place code is accumulating.