Rotki progress in Q2 of 2020

Introduction

This post serves as an update of the work we have been doing in rotki during Q2 of 2020 and especially since the conclusion of the last gitcoin round.

A lot happened in those months. We have grown our community in Discord and Telegram and the general userbase of rotki.

We made 2 big releases, v1.5.0 - Barb and v1.4.0 - Axilla containing a ton of features which will be detailed below.

We have also made 2 smaller releases, v1.4.1 - Axillaries and v1.4.2 - Bird’s back adding smaller features and fixing bugs.

Userbase and Community

Our community has grown considerably. From almost non existant in the start of the year we now have 83 members in discord, 42 members in Telegram and almost 1000 followers in our Twitter account! By far the most users are in discord where interesting conversations happen between users and developers and also where many feature requests are made. Discord is also where we, the rotki developers, coordinate and discuss development so if you wanna see how we do that do join in!

Counting the actual users for a local opensource is not an exact science but the userbase of rotki has also grown considerably! Each new version gets ~300 downloads and we have almost 20 active premium users at the moment. Additionally from the users who have statistics activated we can see we get about 36 sign ins on average daily. This is a very big increase compared to last year where we had ~80 downloads per release, 4 active premium users and 5 sign ins per day.

Features

A lot of new features have been added in the past months. In this section we will see a detailed rundown of the most important of them.

Support for Gemini Exchange

Release v1.4.0 introduced support for the Gemini exchange.

Users simply need to add a Gemini key with the “auditor” permission and rotki will pull all balances, trades, deposits/withdrawals and display them inside the app.

Users can now maintain manually tracked balances

Release v1.4.0 introduced the ability for users to add manually tracked balances.

Users can add any type of asset in any kind of location for tracking. This feature is very important since it allows users to track their balances in exchanges or blockchains which we do not currently support.

Improvements for Kraken users

Kraken users can now choose the tier of kraken account they have from the UI.

This allows them to take advantage of different API rate limits. Unfortunately kraken does not offer a way to auto-detect the account type and as such the user needs to select it from our user interface.

Support for Compound tokens and for aDAI

Rotki can now track all compound tokens and Aave’s aDAI. If you hold any in your accounts they will be auto-detected and their balance will be displayed for you and taken into account in your overall net worth.

Speedup of blockchain queries

We put some work on considerably increasing the speed by which the ethereum blockchain balances are queried by utilizing a set of special contracts in order to save on RPC calls.

Redesign of the welcome screen

We have redesigned the welcome screen!

You are no longer greeted by a dull and boring background but by a patterned moving robin.

Moreover the account creation screen has slightly changed in order to make it easier for you to understand what needs to be filled in when creating a new account.

Redesign of the dashboard

The dashboard’s design has changed considerably.

It has a more modern look with a heavy focus on the user’s total net worth, which comes as an aggregation of all assets over all locations.

Furthermore each exchange, blockchain and other location is shown in the dashboard along with how much value is saved in them. And just like before the list of all assets and their percentage of the netvalue is also present at the bottom of the dashboard.

Ability to change the password

You have asked for this feature and we listened!

It’s now possible for a user to change their password by visiting the account & security page. Simply type in a new password and you are good to go!

Privacy changes

We have introduced a number of privacy related changes that allow users to share screenshots/videos of their rotki without actually sharing any of their sensitive data.

Data scrambling

Users have the ability to activate data scrambling mode.

What this means is that in the dashboard and other pages real numbers are replaced by random numbers each time a page is loaded. This way you can share screenshots of your rotki app experience without sharing any of your data.

Privacy mode

Another feature we introduced is called privacy mode.

Once privacy mode activated all numbers are blurred out.

This way you can be sure that nobody looking at your screen will see anything and you can share a screenshot or a video of a potential bug/problem with the interface and share with us without compomising any of your sensitive data.

Improvements on the MakerDAO DSR page

The MakerDAO DSR page has been improved to have similar look and feel to the vaults page.

You can now filter the DSR balances and how much you have earned per account. Furthermore the list of DSR actions has been greatly improved compared to previous versions. Each action has both the DAI amount and the equivalent amount in USD value at the time of the transaction. Moreover you can check out each action in etherscan by simply clicking a link. Furthermore for each action you can see how much the user has earned in DAI and USD up to the point in time the action happened.

Here is a small demo showcasing the usage of DSR in v1.5.0:

Support for MakerDAO vaults

With v1.5.0 we have also added support for MakerDAO vaults.

The user’s vaults are now auto-detected from the tracked ethereum accounts. The aggregate deposit locked in all vaults can be seen. But also for each vault all the relevant information such as locked up collateral, liquidation rate and outstanding debt are shown.

Furthermore, for premium users, the list of historical actions along with how much DAI/USD is lost to paid interest is shown. Moreover they can create vault watchers.

A watcher resides in the rotki server and watches the given vault for changes in the collateralization ratio. Users can have multiple watchers per vault. If the ratio becomes greater/less than the target ratio then an email alert is sent to the user so he can react quickly and either not be liquidated if the ratio becomes too small or not lose on potential profit if the ratio grows too big.

Here is a small demo showcasing the usage of vaults in v1.5.

Wrapup

Rotki has progressed a lot during Q2 of 2020. We have taken the support of our community and of the people who donated to us during the last gitcoin round and turned it into code that created a better product with many improvements and new features. Rotki’s UI/UX has improved and more ethereum DeFi support has been added. Finally privacy and speed/performance improvements were made.

Conclusion - last half of 2020 and beyond

Heading into the next half of the year rotki is growing up!

We will focus on implementation of the new features requested by users, prioritizing those requested by our paid users and those features that deal with DeFi.

Our online presence will increase even more and so will our userbase which will allow us to perfect the software and make it the best tool for everyone by taking all of your feedback into account.

Stay tuned for more updates and please help us in building the best portfolio tracker and accounting tool that respects your privacy. Ways to do that are:

  • Try out Rotki’s latest release and use it daily.
  • Provide us with feedback in the form of bug reports and feature requests.
  • Star our Github repo and follow us in Twitter.
  • Buy a premium subscription and/or support us financially.
  • Chat with us and other users of Rotki in Telegram or in Discord.
  • Spread the word so that more people get to try and use Rotki and learn how to both manage their finances but also how to protect the privacy of their financial data.

Rotki 2019 - A year in review

Introduction

What a year has this been for Rotki! With less than two days left in 2019 this post is meant to highlight the biggest things that happened in the project during the past 12 months, list what we have achieved and look to what is coming in the future.

Year In Review

January

January started with the publishing of Rotki v0.6.0, the last release before v1.0.

It was a big release containing many bug fixes but also introducing some features like the API query caching or the tax report progress indicator that stay with Rotki even to this date.

Other than that development continued with a good pace.

February

Work on Rotki continued. The project’s source code was ported to Windows and for the first time Rotki gets to run in a Windows environment.

Trying to port code to Windows is not an easy thing, especially coming from a Linux background, but seeing the end result of the app running inside an all familiar looking windows themed frame is really rewarding.

Apart from that a lot of work on improving the experience of the application was done such as accomodating for Token upgrades starting with the new MLN token.

March

Rotki participated in ETHCC 2 in Paris and gave a talk on what Rotki is, what is the problem that we are trying to solve and what would v1.0 bring.

The reactions from the audience and the questions we got were really encouraging. People wanted to learn more about Rotki’s mission, how can they try it but most of all when would it be available in Windows and when would v1.0 be released? To see the full recording of the talk check here.

Meanwhile development steadily continued with sneak peeks of the premium graphs and among other things a lot of UI improvements.

April

Development continued in April but rather slowly. This month was dominated by events in Lefteris’ personal life as he became a father!

May

Slowly development picked up its pace again with various bug fixes done to the app but also some features being implemented. Most notable change that got implemented in May was a complete change in the way assets are handled by Rotki. The application no longer trusted any single token/asset symbol it is given. Instead from here and on it maintains a list of known asset symbols along with their conversions from/to external services. Any asset not in that list is not supported by Rotki. This lets us stop the guessing games about what assets the user has and instead allows us to know all details about each token in question and how it translates in each exchange or price querying website.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
"KEY": {
    "ethereum_address": "0x4CC19356f2D37338b9802aa8E8fc58B0373296E7",
    "ethereum_token_decimals": 18,
    "name": "Selfkey",
    "started": 1508803200,
    "symbol": "KEY",
    "type": "ethereum token"
},
"KEY-2": {
    "ethereum_address": "0x4Cd988AfBad37289BAAf53C13e98E2BD46aAEa8c",
    "ethereum_token_decimals": 18,
    "name": "Bihu KEY",
    "started": 1507822985,
    "symbol": "KEY",
    "type": "ethereum token"
},
"KEY-3": {
    "active": false,
    "ended": 1452038400,
    "name": "KeyCoin",
    "started": 1405382400,
    "symbol": "KEY",
    "type": "own chain"
},

If you are interested to learn more about this topic it has been covered extensively in this post.

June

Development continued with a steady pace towards v1.0.

A lot of work is also happening outside of Github as a website is being built for Rotki which also contains a system that allows premium users to purchase and manage premium subscriptions. Also an API server is being developed for the premiums users of Rotki.

In parallel to all that Kelsos started the slow and painful process of rewriting the UI code using the vue.js framework

July

July is definitely dominated by finally reaching the v1.0 milestone.

The Rotki v1.0 release was the biggest release of Rotki up to now (probably will be overshadowed by v1.1.0 though ;)).

It officially launched the purchasing of Rotki premium subscriptions and the website to support it. It also was the first release to utilize the premium API server to provide the users with the ability to save their data in our servers and get extra statistics and graphs for their assets and activity.

Rotki v1.0 also was the first release to be able to run in Windows.

With Rotki v1.0 the users could now for the first time conveniently see notifications in the top right of the front-end about information or warnings that the software wants to show them instead of always having to read the logfiles.

Finally this version had a ton of bug fixes, and new features for a full list of which you should check the release notes.

August

As if v1.0 in July was not enough, August was a really busy month for Rotki!

As the users started using v1.0, August started with bugfixing of various issues that were reported. Not one, but two bugfixing releases were made within a few days!

In August we also got our first paying premium subscribers, something that boosted our confidence that what we are building is something that people need and that the problem we are solving is worth all the effort we are putting into the project.

We also started getting a lot of feature requests from people in social media and Github

This blog was also started in August with the very first post explaining what Rotki is, what are our values and the vision for the future of the project.

An unforgettable event was our participation in EthBerlinzwei and Dappcon which we even sponsored!

There we talked with many users who were interested in what’s in store for Rotki and we got lots of feedback and advice on how to go forward.

Finally at the very end of the month, a big release containing bug fixes and the most requested features was made. Release v1.0.3 added support for Coinbase which was a feature prioritized via request of a premium subscriber.

It also introduced a dmg installer for OSX users, added a popup warning users when new releases are available and added various smaller features and lots of bug fixes. Check the changelog for more details.

September

Development continued also in September. The biggest change implemented this month was saving all actions inside the database so that users won’t have to re-query each time they run Rotki.

In the meantime traction in social media is slowly increasing. To further improve our online presence we are trying to educate current and potential future users on why Rotki is needed by explaining the problems of centralization, lack of privacy and lack of data ownership that all other portfolio tracking and accounting solutions are facing.

In the meantime yet another post is made in this blog, this time to explain why Rotki maintains its own list of assets and their mappings.

Finally in order to support the Ethereum ecosystem from which we came we also became sponsors of ethereum’s devcon 5 that would take place next month in Osaka, Japan.

October

October started by unleashing a new Rotki release!

Release v1.0.4 contained multiple features and bug fixes. The most noteworthy feature of that release was the ability to import data from cointracking.info. That feature was requested by a premium subscriber and as such was prioritized. For a full list of changes take a look at the changelog.

The most seminal event of October was of course our participation in Ethereum’s Devcon 5 in Osaka, Japan and the talk we gave there regarding the problems of using centralized tools in order to do accounting for the world of decentralized finance. You can find a recorded video of the talk here.

There was a lot of feedback given to us after the talk and during our presence in the conference. The feedback and questions revolved around upcoming DeFi features but also ideas of monetization for the project. There were ample discussions about the direction Rotki is taking as an opensource application trying to monetize itself and we got many ideas on potential ways forward.

Development also continued albeit in a slower pace due to travelling to the other side of the world for the conference.

November

In November development continued trying to fix various bugs and prepare the next upcoming release.

The most noteworthy change that occured in November was the rebranding of the project from Rotkehlchen to Rotki. Since even before v1.0 many people were complaining about the difficulty they faced when trying to pronounce or spell the original name. It made it really hard to spread the word about it, recommend it to friends or even google it. As such rebranding to the diminutive form was absolutely necessary. Github, twitter, website all got renamed. For a full list of what changed check this post.

In November we also had to face the problems introduced by the introduction of Maker DAO Multi-collateral DAI and the renaming of the old DAI to SAI. We developed the required code and DB upgrades to handle it and also explained our view on why renaming an asset like that is misguided in this blogpost.

December

This month, Rotki has been on fire!

December started with the publishing of the last release for the year. Rotki v1.0.5 was released mainly containing the work done for the Maker DAO multi-collateral DAI upgrade. Some minor features and bug fixes were also included in this release. For a full list of changes check the changelog.

After requests from our users we also created two chatrooms where users can chat about Rotki. A Telegram chat and a discord room.

But December, presumably due to the holidays, has been one of our most productive months of work.

We started having two different branches in the project due to the sheer amount of changes happening. The master branch stays as the stable branch where releases are published from. The development branch is where all new work is going to.

The work that Kelsos had started in June in order to switch the entire front-end code to utilize the Vue.js framework was finally finished and got merged.

At the same time a lot of work preparing the project for v.1.1.0 was done. Most noteable of which was the complete removal of ZMQ and replacing it with a full-fledged REST API. Even as of the writing of this post work continues so that v1.1.0 can be ready in January 2020. I can’t describe how much work has been going on in Rotki the past few days. Best way to see it for yourself is to check the PRs in Github.

We also described how would v1.1.0 look in our new year resolutions for 2020 post. Check it out if you would like to see some hints about how v1.1.0 will look like and also some more long-term ideas about Rotki.

Wrapup

What a year has 2019 been for Rotki! We are beaming with pride! So much work has been done, the userbase is steadily growing, we acquired the first paid users and we have gotten more feature requests than we can currently cope with.

We would like to thank all the users who have entrusted us with their business and for all the good wishes and words of support we have gotten over social media. We promise that as we head into 2020 we will not let you down!

Conclusion - 2020 and beyond

Heading into the new decade, we can only be positive about the future of Rotki!

A lot more work will be going into the project in order to fullfill all the feature requests we have been getting. Expect a lot more coming from us and for our online presence to increase and become stronger. The userbase will also steadily keep increasing, which will allow us to perfect the software and make it the best tool for everyone by taking all of your feedback into account.

Stay tuned for more updates and please help us in building the best transparent financial tool that enables you to take ownership of your financial data. Ways to do that are:

  • Try out Rotki’s latest release.
  • Provide us with feedback in the form of bug reports and feature requests.
  • Star our Github repo and follow us in Twitter.
  • Buy a premium subscription and/or support us financially.
  • Chat with us and other users of Rotki in Telegram or in Discord.
  • Spread the word so that more people get to try and use Rotki and learn how to both manage their finances but also how to protect the privacy of their financial data.

Rotki's New Year Resolutions

Introduction

As 2019 draws to a close, a lot of users have been asking us when will certain features be implemented, which features are in the pipeline and generally what’s the roadmap for the future of Rotki as an application. This short post attempts to serve as a go-to answer for these questions, clarify the short-term roadmap and give some hints on what will come in the long-term future.

Short term

Very recently we have created a develop branch in Rotki in order to facilitate all the big breaking changes that are coming. All PRs by default will now be done against develop and thus all big changes that need to be done will stay in that branch. Once a release is done, develop will merge to master and binaries will be published. PRs against master will be reserved for quick patch fixes that can be done independently of any breaking changes in develop.

The next release coming out of will be v1.1.0 and it will contain, among other things, two major features.

Release v1.1.0

Modern UI

The entire UI is being rewritten and turned from the old-school hand-made CSS + bootstrap abominaton to a proper modern framework thanks to the tireless work done by kelsos. At the time of writing this post the work is almost done and the PR is about to be merged.

What does the average user care you may ask? By far the most important advantage of this change is that adding new UI components and thus features will become much easier. Vue.js is a modular framework which makes it trivial to add new components or modify the looks of the UI. In short adding new features is now going to be made easier. God knows there is a lot in the pipeline that needs to be implemented!

Apart from that the looks of the entire app are getting modernized. All components are now more sleek and pleasing to the eye. For example here is the ethereum token selection.

Proper REST API

The current version of Rotki uses the ZMQ protocol in order for the front-end (UI) to communicate with the backend. The API developed for that communication was crude but what’s worse ZMQ libraries for both python and javascript are not kept up to date and are pulling very old dependencies. The ZMQ library is why rotki is stuck in an old version of electron and also why we maintain our own fork of an abandoned node project, the node-zerorpc client.

The entire ZMQ messaging layer is getting rooted out and replaced by a proper REST API.

What does the average user care about this you may ask? Higher electron versions allow us to have more security in the application and take advantage of all the new electron features. Also with ZMQ no longer being a dependency, a very big and fat dependency is out and final binaries would probably be smaller in size.

But more importantly this opens up the way to be able to run Rotki in a headless machine and communicate with it only via the API. That would also enable you to run rotki’s backend in a different machine than the UI.

Finally with this change Rotki will be getting a very good, well documented and tested REST API. Users will now also be able to work with Rotki via command line interfaces. Below is a screenshot of the docs in the work in progress PR that implements the ZMQ to REST API switch.

When?

When it’s ready. Soon ™.

Other releases after v1.1.0

The next big feature planned after that is implementation of support for Coinbase PRO which should hit in the release right after v1.1.0, presumably v1.2.0.

Apart from that there is a lot of issues and feature requests in the backlog that should be handled. Priority will go to supporting new exchanges such as Bitstamp and generally fulfilling user’s wishes such as support for staking in PoS cryptocurrencies.

What would you like to see in the near future implemented in Rotki? Don’t be shy, join us and write up a feature request as a github issue here.

How can I follow the evolution of the roadmap?

As an opensource application, transparency is in the core of Rotki’s ethos. As of the writing of this post our milestones are tracked by Github projects. You can see the current milestones here and inspect which features will be implemented and which bugs will be fixed in which releases.

The current milestones are:

  • Next patch release: Small issues that may pop up and need quick fixes go here. Patch releases are made if required to make quick fixes to an already existing release.
  • Next minor release (currently v1.1.0): Most of the current development always targets the next minor release. All new features that are going to be included in the next release end up going there.
  • Minor release after the next (currently v1.2.0): This is where features that are planned for development go but which we know will not be included in the next minor (feature) release.

Long term

The long term vision for Rotki is for it to become the best portfolio management, tracking and accounting application for both crypto and traditional assets. The tool that not only enables you to manage your finances but also does this in an opensource, transparent way allowing you to own your financial data and not have them lying on a centralized server somewhere in the cloud ready to fall into the hands of malicious actors.

In an ideal future it would also be able to track not only one’s investments but also everyday expenses and provide insight and analytics about the entire spectrum of a user’s finances.

There are no specific Github issues made yet for the various things that we are thinking about the long-term future but as a general idea:

  • Rotki should be able to track traditional assets such as stocks, bonds, real estate and so on.
  • Rotki should be able to manage a user’s daily expenses and provide insights and analytics into spending habits, savings and so on.
  • Users of Rotki should be able to track part of their expenses while on the move so a companion mobile app to Rotki desktop should be made.

What else would you like to see implemented in the long run in Rotki? What would you require from an application that is supposed to be the constant and trusted companion to all your financial analysis needs?

Naturally all the above largely depend on how the current userbase of Rotki grows and how succesfull is the monetization of the application. Without any steady revenue stream or funding all of the above are probably really hard to accomplish.

Conclusion

The future of Rotki is bright! There is a lot of demand in the form of feature requests, and the userbase is steadily increasing. Stay tuned for more updates and please help us in building the best transparent financial tool that enables you to take ownership of your data. Ways to do that are:

  • Try out Rotki’s latest release.
  • Provide us with feedback in the form of bug reports and feature requests.
  • Star our Github repo and follow us in Twitter.
  • Buy a premium subscription and/or support us financially.
  • Spread the word so that more people get to try and use Rotki and learn how to both manage their finances but also how to protect the privacy of their financial data.