10 Tips for Working With Data in Datalore

Alena Guzharina

Greetings from the Datalore team! In this blog post we’ll show you 10 tricks you can use to help you work more productively with data files in Datalore.

Try Datalore!

Before we start

In Datalore, files are persistently attached to notebooks. After you create a notebook and upload some data, you will have access to the data even after you restart the kernel or close and reopen Datalore.

Tip №1: Drag and drop files and folders

Quickly add new files and folders in Datalore by opening the Attached files sidebar tab and dragging and dropping your files and folders there.

Tip №2: Unzip files using the GUI

Uploading files and/or folders in compressed archives is faster because the file size is reduced. After uploading the archive, click the “Unpack” button and it will create a folder and extract the files. Datalore supports .zip, .tar and .tar.gz file extensions.

Tip №3: Sharing notebooks with attached data

When you share a notebook with collaborators, the datasets are shared automatically. You don’t need to give any extra access rights to your colleagues.

Tip №4: Moving and cloning notebooks

If you want to organize your work, you can move, copy, or clone notebooks to different folders and workspaces. The data is copied automatically, so you won’t need to re-upload anything. You can move, copy, and clone the notebook in the file system.

Tip №5: Workspace files

Workspace files help you work with the same data files across several different notebooks without having to upload the files multiple times.

To get started with your workspace, follow these steps:

• Upload files to the whole workspace in the Workspace files tab in the File system.
• Go to the Workspace tab inside the Attached files sidebar menu and click Attach workspace files.
• Don’t forget to follow the prompt to restart the kernel.
• Access files in the notebook code from the /data/workspace_files/ directory or select the file you need and click Copy file path to clipboard.

Tip №6: Extending your cloud storage

In Datalore you can mount S3 buckets to extend internal cloud storage. There’s a detailed guide about how to do it in this blog post.

Tip №7: Upload files by URL

If you have a direct link to a file hosted publicly on the internet, you can upload it to a notebook using its URL. Make sure you use the direct link to the data file and not to an .html page. Open Attached files and сlick the dropdown on the “Upload” button and choose the “Upload by link” option.

Tip №8: Create files inside Datalore

In Datalore you can create files by clicking “New file” in the upper left corner of the Attached files sidebar. This lets you quickly create files and paste content into them.

Tip №9: Preview and edit files inside Datalore

You can preview and edit small text files (less than 100 KB) right inside the editor. Double click the file and the contents will open in a separate editor tab.

Tip №10: Download files using the urllib library

You can easily download files from a specified URL. The urllib library is already pre-installed in Datalore so you can import it and execute code like this:

When you want to publish a notebook and allow others to edit a copy of it, we recommend that you download the dataset inside the code. This will help others to reproduce your calculations in their own notebook copies.

Try Datalore!

We hope these tips for working with data were helpful and gave you some ideas to speed up your current workflow. Let us know in the comments if you have any other tips for working with data in Datalore!

Kind regards,
The Datalore team

Subscribe to Datalore News and Updates

Subscribe form

By submitting this form, I agree to the JetBrains Privacy Policy Notification icon

By submitting this form, I agree that JetBrains s.r.o. ("JetBrains") may use my name, email address, and location data to send me newsletters, including commercial communications, and to process my personal data for this purpose. I agree that JetBrains may process said data using third-party services for this purpose in accordance with the JetBrains Privacy Policy. I understand that I can revoke this consent at any time in my profile. In addition, an unsubscribe link is included in each email.

Submit

Thanks, we've got you!