AppCode
CLion
DataGrip
GoLand
IntelliJ IDEA
MPS
PhpStorm
PyCharm
Rider
RubyMine
WebStorm
Toolbox App
.NET Tools
ReSharper C++
Space
TeamCity
Upsource
YouTrack
HubIntroducing public beta of Datalore – web application for machine learning
Last Monday, February 12, we launched a public beta of Datalore – an intelligent web application for data analysis and visualization in Python.
Today, machine learning is at the heart of many commercial applications and research projects. By introducing Datalore, we’re extending the JetBrains product family to the machine learning-specific environment in Python.
We’re launching this tool inspired by the JetBrains vision – to make development as enjoyable and productive as possible for everyone. Datalore aims to turn working with data into a delightful experience with helpers such as smart coding assistance, incremental computations, and built-in tools for machine learning.
Intelligent and easy-to-use code editor
Data science is an art of drawing insights from raw data, and more often than not this takes coding. To make coding for machine learning an enjoyable and easy experience, Datalore gives you smart code completion, inspections, quick-fixes, and easy navigation.
To simplify your coding routine, we introduce Intentions – context-aware suggestions based on what you’ve just written. Click on the appropriate Intention, and Datalore will generate new code for dataset upload, train/test split, graph design, and much more.
Incremental computations
Fine-tuning machine learning models comes with multiple edits. Suppose you adjust a few model parameters and want to see how it affects its predictions – and you want these results right now. Datalore follows dependencies between various computations in the workbook and minimizes recalculations caused by new changes. This way, the output at the right side of the screen always reflects your latest ideas.
Out-of-the-box machine learning tools
Data analysis starts with Python necessities: numpy, pandas, and sklearn built-in libraries.
On top of that, we’ve developed two advanced visualization libraries: datalore.plot, inspired by the “grammar of graphics” ideas and their R implementation ggplot, and datalore.geo_maps, which enables the addition of interactive maps to your analysis.
There are some built-in datasets (Iris, MNIST, Titanic, and more) to explore, and a handy File Manager to upload original datasets as .csv files.
All edits are saved automatically, so no more worries about lost data. In case something goes wrong, you can always check file history and roll back to an earlier model thanks to Datalore’s built-in version control system.
Collaboration
Take advantage of real-time remote access to the workbook and the code editor. Teammates can add code and write comments on the go while discussing ideas.
Different computational instances
Datalore gives you access to various computational resources depending on what you are working on. Simple algorithms run on small computational agents, while deep learning algorithms require more powerful agents. Please contact us via the Datalore forum if you want to work with larger instances.
What’s next?
Go to datalore.io and try it!
We are excited and anxious to get your feedback via the Datalore forum – the quickest way to share your opinion. Tell us about issues you’ve encountered and features you would like to see, and reach out to our team and other users. You can also find us on Twitter. Datalore is still under development and we look forward to your insights to make it even more awesome!
Datalore Team
Mehmet Ali SICAK says:
February 20, 2018Good job. Thanks. I trying now. Can i use with kotlin?
Zoya Cherkasova says:
February 20, 2018Thank you! Right now we’re supporting Python and concentrate on machine-learning specific tasks and their solutions. Python has a solid, widely-supported set of tools and libraries for getting these tasks done.
Moulick says:
February 20, 2018I wish this was avaliable offline, kinda like the your other IDEs.
Brian says:
February 22, 2018Agreed. I’d really like to use this product, but my company would never allow me to use it unless it was hosted on-premises or available as an offline tool.
Ryan says:
May 4, 2018I agree,
This is an amazing beta. However my company too would disapprove of producing company data/insights on servers that were not controlled by them. This could be such a great tool if it were available via either a plugin in Intellij or a standalone application.
Please consider allowing a self hosted edition of this software. In fact on second thought I can’t imagine any company allowing their data to be hosted without their control especially with GDPR and other regulations due to hit mainstream in the coming years if not months.
I can completely justify publishing a workspace to the “cloud” for the sake of collaboration, where the published information can be controlled, but for any real internal data analysis I just don’t see a company supporting this without an option to control the data.
Madhavan says:
June 1, 2020Agree. Cannot use it because it is public
Hamidreza says:
February 21, 2018Good job. It seems great.
Right use of the SaaS. I think it can be better in collaboration with Google Compute Engine and it’s TPU-powered instances.
I think the JetBrains is who can import Kotlin to the Machine Learning Ecosystem. Please think about it.
Zoya Cherkasova says:
February 21, 2018Thank you! We got so many requests for Kotlin support that now we’re thinking it might be implemented (eventually).
Vaclav says:
February 21, 2018I am trying to create account. How do I accept the terms of use? Cannot find the button.
https://www.screencast.com/t/kPwFoa4Np2
Zoya Cherkasova says:
February 21, 2018Hmm, it should have appeared at this point. Can you tell us what browser and its version you’re using? Also, please check that you have JavaScript enabled (Settings – Advanced – Privacy and security/Content settings)
Tom says:
February 22, 2018Same problem. Chrome Version 64.0.3282.167 (Official Build) (64-bit) on Windows 10.
Sergey Smolnikov says:
February 23, 2018It’s there – just has “opacity=0” (Chrome)
https://s3.amazonaws.com/pub-imgs-8765786548765123/datalor-accept-button.jpg
Maryna Cherniavska says:
February 21, 2018Is there any tutorial, like with the Kotlin koans?
Zoya Cherkasova says:
February 21, 2018We’re working on tutorials right now, so stay tuned. For now, “Samples” folder contents provide some models and visualizations and their implementation.
Moulick says:
February 22, 2018Getting a privacy error while trying to login. https://i.imgur.com/GgMsOsn.png
Rachel says:
February 22, 2018This is great! Do you have any stickers? Would love to show my support.
black watch says:
February 22, 2018Hi, I think your site might be having browser compatibility issues.
When I look at your blog in Safari, it looks fine but when opening
in Internet Explorer, it has some overlapping.
I just wanted to give you a quick heads up! Other then that, awesome blog!
DrEmmettBrown says:
February 22, 2018Hi ,
At first , good job!
is there any plan to support coding with R? I guess R is much-deserved attention than other alternatives.
Felipe Martins says:
February 22, 2018wow!
Matt says:
May 29, 2018Nice Star Trek TNG reference!
Jeff Johnson says:
June 1, 2018Wow! great article and I learned so much from this blog, it is very helpful in every information you thought us. Great job!
Harshali says:
October 24, 2018Hey, I love the product, but can we code it with R?
JB says:
November 14, 2018Needs a private cloud option.