Using Kaggle Datasets in Google Colab

You should be able to access any dataset on Kaggle via the API. In this example, only the datasets for competitions are being listed. You can see that datasets you can access with this command:

kaggle datasets list

You can also search for datasets by adding the -s tag and then the search term you're interested in. So this would give you a list of datasets about dogs:

kaggle datasets list -s dogs

You can find more information on the API and how to use it in the documentation here.

Hope that helps! :)


Detailed approach:

  1. Go to my account in your profile

enter image description here

  1. Scroll down, until you find an option Create new Api Token, this will download a file called kaggle.json

enter image description here

  1. Go to Colab upload the file kaggle.json

enter image description here

  1. pip install kaggle

enter image description here

  1. create a new folder named kaggle, copy kaggle.json into the kaggle folder, and set read-write permissions only for you(user).

enter image description here

6.Go to Kaggle website.For example, you want to download any data, click on the three dots in the right hand side of the screen. Then click copy API command

enter image description here

  1. Go to colab, paste the API command

enter image description here

8.When you do an !ls, you will see that our download is a zip file.

enter image description here

  1. To unzip the file use the following command

enter image description here

  1. Now, when you do !ls you'll find our csv file is extracted from the zip file.

enter image description here

  1. To read the file perform a simple pd.read_csv, import pandas

enter image description here

12.As you see, we have successfully read our file into colab.

enter image description here

This downloads the kaggle dataset into google colab, where you can perform analysis and build amazing machine learning models or train neural networks.

Happy Analysis!!!


Step-by-step --

  1. Create an API key in Kaggle.

    To do this, go to kaggle.com/ and open your user settings page. settings nav

  2. Next, scroll down to the API access section and click generate to download an API key. api token This will download a file called kaggle.json to your computer. You'll use this file in Colab to access Kaggle datasets and competitions.

  3. Navigate to https://colab.research.google.com/.

  4. Upload your kaggle.json file using the following snippet in a code cell:

    from google.colab import files files.upload()

  5. Install the kaggle API using !pip install -q kaggle

  6. Move the kaggle.json file into ~/.kaggle, which is where the API client expects your token to be located:

    !mkdir -p ~/.kaggle !cp kaggle.json ~/.kaggle/

  7. Now you can access datasets using the client, e.g., !kaggle datasets list.

Here's a complete example notebook of the Colab portion of this process: https://colab.research.google.com/drive/1DofKEdQYaXmDWBzuResXWWvxhLgDeVyl

This example shows uploading the kaggle.json file, the Kaggle API client, and using the Kaggle client to download a dataset.