{"id":35575,"date":"2023-08-28T10:10:19","date_gmt":"2023-08-28T17:10:19","guid":{"rendered":"https:\/\/coderpad.io\/?post_type=doc&#038;p=35575"},"modified":"2024-08-28T13:50:53","modified_gmt":"2024-08-28T20:50:53","slug":"jupyter-notebooks","status":"publish","type":"doc","link":"https:\/\/coderpad.io\/resources\/docs\/interview\/pads\/jupyter-notebooks\/","title":{"rendered":"Jupyter Notebooks"},"content":{"rendered":"\n<p>The Jupyter Notebook integration for CoderPad allows you to utilize one of seven versions of this popular data science platform.<\/p>\n\n\n\n<p>Each notebook will pre-load with different libraries, you can find more information on the specific libraries in <a href=\"https:\/\/jupyter-docker-stacks.readthedocs.io\/en\/latest\/using\/selecting.html\" target=\"_blank\" rel=\"noreferrer noopener\">Jupyter&#8217;s documentation<\/a>.<\/p>\n\n\n\n<p>To work with Jupyter Notebooks in CoderPad, you can either open a pad, and select one of the notebook versions from the drop down&#8230;<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><a href=\"https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-67.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"437\" src=\"https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-67-1024x437.png\" alt=\"The language menu is shown in a pad and the notebooks section is highlighted.\" class=\"wp-image-40779\" srcset=\"https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-67-1024x437.png 1024w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-67-300x128.png 300w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-67-768x327.png 768w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-67-18x8.png 18w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-67.png 1243w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n<\/div>\n\n\n<p>Or you can create a Jupyter-based question by selecting a version from the question wizard and editing the content as needed.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><a href=\"https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-68.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"557\" src=\"https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-68-1024x557.png\" alt=\"The question wizard with the language drop down open, and the notebooks section highlighted.\" class=\"wp-image-40782\" srcset=\"https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-68-1024x557.png 1024w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-68-300x163.png 300w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-68-768x418.png 768w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-68-18x10.png 18w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/08\/image-68.png 1333w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n<\/div>\n\n\n<p>When you or your candidate open your Jupyter Notebook pad, you&#8217;ll be presented with a pad-embedded version that works just like it would out-of-the-box &#8212; you&#8217;ll have all the same functionality and features as the versions you&#8217;ve used outside of CoderPad Interview.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><a href=\"https:\/\/d2h1bfu6zrdxog.cloudfront.net\/wp-content\/uploads\/2023\/07\/image-13.png\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"622\" src=\"https:\/\/d2h1bfu6zrdxog.cloudfront.net\/wp-content\/uploads\/2023\/07\/image-13-1024x622.png\" alt=\"\" class=\"wp-image-35585\" srcset=\"https:\/\/coderpad.io\/wp-content\/uploads\/2023\/07\/image-13-1024x622.png 1024w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/07\/image-13-300x182.png 300w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/07\/image-13-768x466.png 768w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/07\/image-13-18x12.png 18w, https:\/\/coderpad.io\/wp-content\/uploads\/2023\/07\/image-13.png 1141w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n<\/div>\n\n\n<p>However, you&#8217;ll have the added benefit of CoderPad features &#8212; for example the ability to collaborate with a candidate over video, take your own private notes the candidate can&#8217;t see, and make use of Drawing mode. <\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u2705 Playback is not yet available with Jupyter, but the notebook will still be available for review.<\/p>\n<\/blockquote>\n\n\n\n<div class=\"wp-block-rank-math-toc-block\" id=\"rank-math-toc\"><nav aria-label=\"Table of Contents\"><ul><li class=\"\"><a href=\"#notebook-versions\">Notebook versions<\/a><ul><li class=\"\"><a href=\"#minimal-notebook\">Minimal notebook<\/a><\/li><li class=\"\"><a href=\"#sci-py-notebook\">SciPy notebook<\/a><\/li><li class=\"\"><a href=\"#r-notebook\">R notebook<\/a><\/li><li class=\"\"><a href=\"#tensor-flow-notebook\">TensorFlow notebook<\/a><\/li><li class=\"\"><a href=\"#py-torch\">PyTorch<\/a><\/li><li class=\"\"><a href=\"#transformers\">Transformers<\/a><\/li><li class=\"\"><a href=\"#py-spark\">PySpark<\/a><\/li><\/ul><\/li><li class=\"\"><a href=\"#container-limits\">Container Limits<\/a><\/li><\/ul><\/nav><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"notebook-versions\">Notebook versions<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"minimal-notebook\"><strong>Minimal notebook<\/strong><\/h3>\n\n\n\n<p>This Pad is running a Jupyter instance, built off of the&nbsp;<code>jupyter\/minimal-notebook<\/code>&nbsp;Docker image provided by&nbsp;<a href=\"https:\/\/jupyter-docker-stacks.readthedocs.io\/en\/latest\/using\/selecting.html#jupyter-minimal-notebook\" target=\"_blank\" rel=\"noopener\">Jupyter Docker Stacks<\/a>. Not much is provided out of the box with this image, but you can customize it to your needs by installing the packages you require.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"sci-py-notebook\"><strong>SciPy notebook<\/strong><\/h3>\n\n\n\n<p>This Pad is running a Jupyter instance, built off of the&nbsp;<code>jupyter\/scipy-notebook<\/code>&nbsp;Docker image provided by&nbsp;<a href=\"https:\/\/jupyter-docker-stacks.readthedocs.io\/en\/latest\/using\/selecting.html#jupyter-scipy-notebook\" target=\"_blank\" rel=\"noopener\">Jupyter Docker Stacks<\/a>. This image includes popular packages from the scientific Python ecosystem:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/altair-viz.github.io\/\" target=\"_blank\" rel=\"noopener\">altair<\/a>,&nbsp;<a href=\"https:\/\/www.crummy.com\/software\/BeautifulSoup\/\" target=\"_blank\" rel=\"noopener\">beautifulsoup4<\/a>,&nbsp;<a href=\"https:\/\/docs.bokeh.org\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bokeh<\/a>,&nbsp;<a href=\"https:\/\/bottleneck.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bottleneck<\/a>,&nbsp;<a href=\"https:\/\/github.com\/cloudpipe\/cloudpickle\" target=\"_blank\" rel=\"noopener\">cloudpickle<\/a>,&nbsp;<a href=\"https:\/\/www.openblas.net\/\" target=\"_blank\" rel=\"noopener\">conda-forge::blas=*=openblas<\/a>,&nbsp;<a href=\"https:\/\/cython.org\/\" target=\"_blank\" rel=\"noopener\">cython<\/a>,&nbsp;<a href=\"https:\/\/www.dask.org\/\" target=\"_blank\" rel=\"noopener\">dask<\/a>,&nbsp;<a href=\"https:\/\/pypi.org\/project\/dill\/\" target=\"_blank\" rel=\"noopener\">dill<\/a>,&nbsp;<a href=\"https:\/\/www.h5py.org\/\" target=\"_blank\" rel=\"noopener\">h5py<\/a>,&nbsp;<a href=\"https:\/\/github.com\/jupyterlab\/jupyterlab-git\" target=\"_blank\" rel=\"noopener\">jupyterlab-git<\/a>,&nbsp;<a href=\"https:\/\/matplotlib.org\/\" target=\"_blank\" rel=\"noopener\">matplotlib-base<\/a>,&nbsp;<a href=\"https:\/\/numba.pydata.org\/\" target=\"_blank\" rel=\"noopener\">numba<\/a>,&nbsp;<a href=\"https:\/\/github.com\/pydata\/numexpr\" target=\"_blank\" rel=\"noopener\">numexpr<\/a>,&nbsp;<a href=\"https:\/\/openpyxl.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">openpyxl<\/a>,&nbsp;<a href=\"https:\/\/pandas.pydata.org\/\" target=\"_blank\" rel=\"noopener\">pandas<\/a>,&nbsp;<a href=\"https:\/\/patsy.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">patsy<\/a>,&nbsp;<a href=\"https:\/\/protobuf.dev\/getting-started\/pythontutorial\/\" target=\"_blank\" rel=\"noopener\">protobuf<\/a>,&nbsp;<a href=\"https:\/\/www.pytables.org\/\" target=\"_blank\" rel=\"noopener\">pytables<\/a>,&nbsp;<a href=\"https:\/\/scikit-image.org\/\" target=\"_blank\" rel=\"noopener\">scikit-image<\/a>,&nbsp;<a href=\"https:\/\/scikit-learn.org\/stable\/\" target=\"_blank\" rel=\"noopener\">scikit-learn<\/a>,&nbsp;<a href=\"https:\/\/scipy.org\/\" target=\"_blank\" rel=\"noopener\">scipy<\/a>,&nbsp;<a href=\"https:\/\/seaborn.pydata.org\/\" target=\"_blank\" rel=\"noopener\">seaborn<\/a>,&nbsp;<a href=\"https:\/\/www.sqlalchemy.org\/\" target=\"_blank\" rel=\"noopener\">sqlalchemy<\/a>,&nbsp;<a href=\"https:\/\/www.statsmodels.org\/stable\/index.html\" target=\"_blank\" rel=\"noopener\">statsmodel<\/a>,&nbsp;<a href=\"https:\/\/www.sympy.org\/en\/index.html\" target=\"_blank\" rel=\"noopener\">sympy<\/a>,&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/latest\/user_install.html#installing-in-classic-jupyter-notebook\" target=\"_blank\" rel=\"noopener\">widgetsnbextension<\/a>,&nbsp;<a href=\"https:\/\/www.python-excel.org\/\" target=\"_blank\" rel=\"noopener\">xlrd<\/a>&nbsp;packages.<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/matplotlib\/ipympl\" target=\"_blank\" rel=\"noopener\">ipympl<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">ipywidgets<\/a>&nbsp;for interactive visualizations and plots in Python notebooks.<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/PAIR-code\/facets\" target=\"_blank\" rel=\"noopener\">Facets<\/a>&nbsp;for visualizing machine learning datasets.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"r-notebook\"><strong>R notebook<\/strong><\/h3>\n\n\n\n<p>This Pad is running a Jupyter instance, built off of the&nbsp;<code>jupyter\/r-notebook<\/code>&nbsp;Docker image provided by&nbsp;<a href=\"https:\/\/jupyter-docker-stacks.readthedocs.io\/en\/latest\/using\/selecting.html#jupyter-r-notebook\" target=\"_blank\" rel=\"noopener\">Jupyter Docker Stacks<\/a>. This image includes popular packages from the R ecosystem:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The&nbsp;<a href=\"https:\/\/www.r-project.org\/\" target=\"_blank\" rel=\"noopener\">R<\/a>&nbsp;interpreter and base environment.<\/li>\n\n\n\n<li><a href=\"https:\/\/irkernel.github.io\/\" target=\"_blank\" rel=\"noopener\">IRKernel<\/a>&nbsp;to support R code in Jupyter notebooks.<\/li>\n\n\n\n<li><a href=\"https:\/\/www.tidyverse.org\/\" target=\"_blank\" rel=\"noopener\">tidyverse<\/a>&nbsp;packages from&nbsp;<a href=\"https:\/\/conda-forge.org\/feedstock-outputs\/index.html\" target=\"_blank\" rel=\"noopener\">conda-forge<\/a>.<\/li>\n\n\n\n<li><a href=\"https:\/\/topepo.github.io\/caret\/index.html\" target=\"_blank\" rel=\"noopener\">caret<\/a>,&nbsp;<a href=\"https:\/\/cran.r-project.org\/web\/packages\/crayon\/index.html\" target=\"_blank\" rel=\"noopener\">crayon<\/a>,&nbsp;<a href=\"https:\/\/cran.r-project.org\/web\/packages\/devtools\/index.html\" target=\"_blank\" rel=\"noopener\">devtools<\/a>,&nbsp;<a href=\"https:\/\/cran.r-project.org\/web\/packages\/forecast\/index.html\" target=\"_blank\" rel=\"noopener\">forecast<\/a>,&nbsp;<a href=\"https:\/\/cran.r-project.org\/web\/packages\/hexbin\/index.html\" target=\"_blank\" rel=\"noopener\">hexbin<\/a>,&nbsp;<a href=\"https:\/\/cran.r-project.org\/web\/packages\/htmltools\/index.html\" target=\"_blank\" rel=\"noopener\">htmltools<\/a>,&nbsp;<a href=\"https:\/\/www.htmlwidgets.org\/\" target=\"_blank\" rel=\"noopener\">htmlwidgets<\/a>,&nbsp;<a href=\"https:\/\/cran.r-project.org\/web\/packages\/nycflights13\/index.html\" target=\"_blank\" rel=\"noopener\">nycflights13<\/a>,&nbsp;<a href=\"https:\/\/cran.r-project.org\/web\/packages\/randomForest\/index.html\" target=\"_blank\" rel=\"noopener\">randomforest<\/a>,&nbsp;<br><a href=\"https:\/\/cran.r-project.org\/web\/packages\/RCurl\/index.html\" target=\"_blank\" rel=\"noopener\">rcurl<\/a>,&nbsp;<a href=\"https:\/\/rmarkdown.rstudio.com\/\" target=\"_blank\" rel=\"noopener\">rmarkdown<\/a>,&nbsp;<a href=\"https:\/\/cran.r-project.org\/web\/packages\/RODBC\/index.html\" target=\"_blank\" rel=\"noopener\">rodbc<\/a>,&nbsp;<a href=\"https:\/\/cran.r-project.org\/web\/packages\/RSQLite\/index.html\" target=\"_blank\" rel=\"noopener\">rsqlite<\/a>,&nbsp;<a href=\"https:\/\/shiny.posit.co\/\" target=\"_blank\" rel=\"noopener\">shiny<\/a>,&nbsp;<a href=\"https:\/\/www.tidymodels.org\/\" target=\"_blank\" rel=\"noopener\">tidymodels<\/a>,&nbsp;<a href=\"https:\/\/www.unixodbc.org\/\" target=\"_blank\" rel=\"noopener\">unixodbc<\/a>&nbsp;packages from&nbsp;<a href=\"https:\/\/conda-forge.org\/feedstock-outputs\/index.html\" target=\"_blank\" rel=\"noopener\">conda-forge<\/a>.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"tensor-flow-notebook\"><strong>TensorFlow notebook<\/strong><\/h3>\n\n\n\n<p>This Pad is running a Jupyter instance, built off of the&nbsp;<code>jupyter\/tensorflow-notebook<\/code>&nbsp;Docker image provided by&nbsp;<a href=\"https:\/\/jupyter-docker-stacks.readthedocs.io\/en\/latest\/using\/selecting.html#jupyter-tensorflow-notebook\" target=\"_blank\" rel=\"noopener\">Jupyter Docker Stacks<\/a>. This image includes popular packages from the scientific Python ecosystem, as well as the&nbsp;<a href=\"https:\/\/www.tensorflow.org\/\" target=\"_blank\" rel=\"noopener\">tensorflow<\/a>&nbsp;machine learning library:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/altair-viz.github.io\/\" target=\"_blank\" rel=\"noopener\">altair<\/a>,&nbsp;<a href=\"https:\/\/www.crummy.com\/software\/BeautifulSoup\/\" target=\"_blank\" rel=\"noopener\">beautifulsoup4<\/a>,&nbsp;<a href=\"https:\/\/docs.bokeh.org\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bokeh<\/a>,&nbsp;<a href=\"https:\/\/bottleneck.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bottleneck<\/a>,&nbsp;<a href=\"https:\/\/github.com\/cloudpipe\/cloudpickle\" target=\"_blank\" rel=\"noopener\">cloudpickle<\/a>,&nbsp;<a href=\"https:\/\/www.openblas.net\/\" target=\"_blank\" rel=\"noopener\">conda-forge::blas=*=openblas<\/a>,&nbsp;<a href=\"https:\/\/cython.org\/\" target=\"_blank\" rel=\"noopener\">cython<\/a>,&nbsp;<a href=\"https:\/\/www.dask.org\/\" target=\"_blank\" rel=\"noopener\">dask<\/a>,&nbsp;<a href=\"https:\/\/pypi.org\/project\/dill\/\" target=\"_blank\" rel=\"noopener\">dill<\/a>,&nbsp;<a href=\"https:\/\/www.h5py.org\/\" target=\"_blank\" rel=\"noopener\">h5py<\/a>,&nbsp;<a href=\"https:\/\/github.com\/jupyterlab\/jupyterlab-git\" target=\"_blank\" rel=\"noopener\">jupyterlab-git<\/a>,&nbsp;<a href=\"https:\/\/matplotlib.org\/\" target=\"_blank\" rel=\"noopener\">matplotlib-base<\/a>,&nbsp;<a href=\"https:\/\/numba.pydata.org\/\" target=\"_blank\" rel=\"noopener\">numba<\/a>,&nbsp;<a href=\"https:\/\/github.com\/pydata\/numexpr\" target=\"_blank\" rel=\"noopener\">numexpr<\/a>,&nbsp;<a href=\"https:\/\/openpyxl.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">openpyxl<\/a>,&nbsp;<a href=\"https:\/\/pandas.pydata.org\/\" target=\"_blank\" rel=\"noopener\">pandas<\/a>,&nbsp;<a href=\"https:\/\/patsy.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">patsy<\/a>,&nbsp;<a href=\"https:\/\/protobuf.dev\/getting-started\/pythontutorial\/\" target=\"_blank\" rel=\"noopener\">protobuf<\/a>,&nbsp;<a href=\"https:\/\/www.pytables.org\/\" target=\"_blank\" rel=\"noopener\">pytables<\/a>,&nbsp;<a href=\"https:\/\/scikit-image.org\/\" target=\"_blank\" rel=\"noopener\">scikit-image<\/a>,&nbsp;<a href=\"https:\/\/scikit-learn.org\/stable\/\" target=\"_blank\" rel=\"noopener\">scikit-learn<\/a>,&nbsp;<a href=\"https:\/\/scipy.org\/\" target=\"_blank\" rel=\"noopener\">scipy<\/a>,&nbsp;<a href=\"https:\/\/seaborn.pydata.org\/\" target=\"_blank\" rel=\"noopener\">seaborn<\/a>,&nbsp;<a href=\"https:\/\/www.sqlalchemy.org\/\" target=\"_blank\" rel=\"noopener\">sqlalchemy<\/a>,&nbsp;<a href=\"https:\/\/www.statsmodels.org\/stable\/index.html\" target=\"_blank\" rel=\"noopener\">statsmodel<\/a>,&nbsp;<a href=\"https:\/\/www.sympy.org\/en\/index.html\" target=\"_blank\" rel=\"noopener\">sympy<\/a>,&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/latest\/user_install.html#installing-in-classic-jupyter-notebook\" target=\"_blank\" rel=\"noopener\">widgetsnbextension<\/a>,&nbsp;<a href=\"https:\/\/www.python-excel.org\/\" target=\"_blank\" rel=\"noopener\">xlrd<\/a>&nbsp;packages.<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/matplotlib\/ipympl\" target=\"_blank\" rel=\"noopener\">ipympl<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">ipywidgets<\/a>&nbsp;for interactive visualizations and plots in Python notebooks.<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/PAIR-code\/facets\" target=\"_blank\" rel=\"noopener\">Facets<\/a>&nbsp;for visualizing machine learning datasets.<\/li>\n\n\n\n<li><a href=\"https:\/\/www.tensorflow.org\/\" target=\"_blank\" rel=\"noopener\">tensorflow<\/a>&nbsp;for creating machine learning models.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"py-torch\"><strong>PyTorch<\/strong><\/h3>\n\n\n\n<p>This pad is running a Jupyter instance, built off of the&nbsp;<code>jupyter\/pytorch-notebook<\/code>&nbsp;Docker image provided by&nbsp;<a href=\"https:\/\/jupyter-docker-stacks.readthedocs.io\/en\/latest\/using\/selecting.html#jupyter-pytorch-notebook\" target=\"_blank\" rel=\"noopener\">Jupyter Docker Stacks<\/a>. This image includes popular packages from the scientific Python ecosystem, as well as the <a href=\"https:\/\/pytorch.org\/\" target=\"_blank\" rel=\"noopener\">pytorch<\/a> machine learning library:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/altair-viz.github.io\/\" target=\"_blank\" rel=\"noopener\">altair<\/a>,&nbsp;<a href=\"https:\/\/www.crummy.com\/software\/BeautifulSoup\/\" target=\"_blank\" rel=\"noopener\">beautifulsoup4<\/a>,&nbsp;<a href=\"https:\/\/docs.bokeh.org\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bokeh<\/a>,&nbsp;<a href=\"https:\/\/bottleneck.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bottleneck<\/a>,&nbsp;<a href=\"https:\/\/github.com\/cloudpipe\/cloudpickle\" target=\"_blank\" rel=\"noopener\">cloudpickle<\/a>,&nbsp;<a href=\"https:\/\/www.openblas.net\/\" target=\"_blank\" rel=\"noopener\">conda-forge::blas=*=openblas<\/a>,&nbsp;<a href=\"https:\/\/cython.org\/\" target=\"_blank\" rel=\"noopener\">cython<\/a>,&nbsp;<a href=\"https:\/\/www.dask.org\/\" target=\"_blank\" rel=\"noopener\">dask<\/a>,&nbsp;<a href=\"https:\/\/pypi.org\/project\/dill\/\" target=\"_blank\" rel=\"noopener\">dill<\/a>,&nbsp;<a href=\"https:\/\/www.h5py.org\/\" target=\"_blank\" rel=\"noopener\">h5py<\/a>,&nbsp;<a href=\"https:\/\/github.com\/jupyterlab\/jupyterlab-git\" target=\"_blank\" rel=\"noopener\">jupyterlab-git<\/a>,&nbsp;<a href=\"https:\/\/matplotlib.org\/\" target=\"_blank\" rel=\"noopener\">matplotlib-base<\/a>,&nbsp;<a href=\"https:\/\/numba.pydata.org\/\" target=\"_blank\" rel=\"noopener\">numba<\/a>,&nbsp;<a href=\"https:\/\/github.com\/pydata\/numexpr\" target=\"_blank\" rel=\"noopener\">numexpr<\/a>,&nbsp;<a href=\"https:\/\/openpyxl.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">openpyxl<\/a>,&nbsp;<a href=\"https:\/\/pandas.pydata.org\/\" target=\"_blank\" rel=\"noopener\">pandas<\/a>,&nbsp;<a href=\"https:\/\/patsy.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">patsy<\/a>,&nbsp;<a href=\"https:\/\/protobuf.dev\/getting-started\/pythontutorial\/\" target=\"_blank\" rel=\"noopener\">protobuf<\/a>,&nbsp;<a href=\"https:\/\/www.pytables.org\/\" target=\"_blank\" rel=\"noopener\">pytables<\/a>,&nbsp;<a href=\"https:\/\/scikit-image.org\/\" target=\"_blank\" rel=\"noopener\">scikit-image<\/a>,&nbsp;<a href=\"https:\/\/scikit-learn.org\/stable\/\" target=\"_blank\" rel=\"noopener\">scikit-learn<\/a>,&nbsp;<a href=\"https:\/\/scipy.org\/\" target=\"_blank\" rel=\"noopener\">scipy<\/a>,&nbsp;<a href=\"https:\/\/seaborn.pydata.org\/\" target=\"_blank\" rel=\"noopener\">seaborn<\/a>,&nbsp;<a href=\"https:\/\/www.sqlalchemy.org\/\" target=\"_blank\" rel=\"noopener\">sqlalchemy<\/a>,&nbsp;<a href=\"https:\/\/www.statsmodels.org\/stable\/index.html\" target=\"_blank\" rel=\"noopener\">statsmodel<\/a>,&nbsp;<a href=\"https:\/\/www.sympy.org\/en\/index.html\" target=\"_blank\" rel=\"noopener\">sympy<\/a>,&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/latest\/user_install.html#installing-in-classic-jupyter-notebook\" target=\"_blank\" rel=\"noopener\">widgetsnbextension<\/a>,&nbsp;<a href=\"https:\/\/www.python-excel.org\/\" target=\"_blank\" rel=\"noopener\">xlrd<\/a>&nbsp;packages.<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/matplotlib\/ipympl\" target=\"_blank\" rel=\"noopener\">ipympl<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">ipywidgets<\/a>&nbsp;for interactive visualizations and plots in Python notebooks.<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/PAIR-code\/facets\" target=\"_blank\" rel=\"noopener\">Facets<\/a>&nbsp;for visualizing machine learning datasets.<\/li>\n\n\n\n<li><a href=\"https:\/\/pytorch.org\/\" target=\"_blank\" rel=\"noopener\">pytorch<\/a>&nbsp;for creating machine learning models.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"transformers\"><strong>Transformers<\/strong><\/h3>\n\n\n\n<p>This pad is running a Jupyter instance, pre-installed with the&nbsp;<a href=\"https:\/\/huggingface.co\/docs\/transformers\/index\" target=\"_blank\" rel=\"noopener\">Transformers Library<\/a>&nbsp;and other popular NLP frameworks and scientific Python packages:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.tensorflow.org\/\" target=\"_blank\" rel=\"noopener\">tensorflow<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/pytorch.org\/\" target=\"_blank\" rel=\"noopener\">pytorch<\/a>,&nbsp;<code>torchvision<\/code>, and&nbsp;<code>torchaudio<\/code><\/li>\n\n\n\n<li><a href=\"https:\/\/jax.readthedocs.io\/en\/latest\/quickstart.html\/\" target=\"_blank\" rel=\"noopener\">jax<\/a>,&nbsp;<code>jaxlib<\/code>, and&nbsp;<code>optax<\/code><\/li>\n\n\n\n<li><a href=\"https:\/\/altair-viz.github.io\/\" target=\"_blank\" rel=\"noopener\">altair<\/a>,&nbsp;<a href=\"https:\/\/www.crummy.com\/software\/BeautifulSoup\/\" target=\"_blank\" rel=\"noopener\">beautifulsoup4<\/a>,&nbsp;<a href=\"https:\/\/docs.bokeh.org\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bokeh<\/a>,&nbsp;<a href=\"https:\/\/bottleneck.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bottleneck<\/a>,&nbsp;<a href=\"https:\/\/github.com\/cloudpipe\/cloudpickle\" target=\"_blank\" rel=\"noopener\">cloudpickle<\/a>,&nbsp;<a href=\"https:\/\/www.openblas.net\/\" target=\"_blank\" rel=\"noopener\">conda-forge::blas=*=openblas<\/a>,&nbsp;<a href=\"https:\/\/cython.org\/\" target=\"_blank\" rel=\"noopener\">cython<\/a>,&nbsp;<a href=\"https:\/\/www.dask.org\/\" target=\"_blank\" rel=\"noopener\">dask<\/a>,&nbsp;<a href=\"https:\/\/pypi.org\/project\/dill\/\" target=\"_blank\" rel=\"noopener\">dill<\/a>,&nbsp;<a href=\"https:\/\/www.h5py.org\/\" target=\"_blank\" rel=\"noopener\">h5py<\/a>,&nbsp;<a href=\"https:\/\/github.com\/jupyterlab\/jupyterlab-git\" target=\"_blank\" rel=\"noopener\">jupyterlab-git<\/a>,&nbsp;<a href=\"https:\/\/matplotlib.org\/\" target=\"_blank\" rel=\"noopener\">matplotlib-base<\/a>,&nbsp;<a href=\"https:\/\/numba.pydata.org\/\" target=\"_blank\" rel=\"noopener\">numba<\/a>,&nbsp;<a href=\"https:\/\/github.com\/pydata\/numexpr\" target=\"_blank\" rel=\"noopener\">numexpr<\/a>,&nbsp;<a href=\"https:\/\/openpyxl.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">openpyxl<\/a>,&nbsp;<a href=\"https:\/\/pandas.pydata.org\/\" target=\"_blank\" rel=\"noopener\">pandas<\/a>,&nbsp;<a href=\"https:\/\/patsy.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">patsy<\/a>,&nbsp;<a href=\"https:\/\/protobuf.dev\/getting-started\/pythontutorial\/\" target=\"_blank\" rel=\"noopener\">protobuf<\/a>,&nbsp;<a href=\"https:\/\/www.pytables.org\/\" target=\"_blank\" rel=\"noopener\">pytables<\/a>,&nbsp;<a href=\"https:\/\/scikit-image.org\/\" target=\"_blank\" rel=\"noopener\">scikit-image<\/a>,&nbsp;<a href=\"https:\/\/scikit-learn.org\/stable\/\" target=\"_blank\" rel=\"noopener\">scikit-learn<\/a>,&nbsp;<a href=\"https:\/\/scipy.org\/\" target=\"_blank\" rel=\"noopener\">scipy<\/a>,&nbsp;<a href=\"https:\/\/seaborn.pydata.org\/\" target=\"_blank\" rel=\"noopener\">seaborn<\/a>,&nbsp;<a href=\"https:\/\/www.sqlalchemy.org\/\" target=\"_blank\" rel=\"noopener\">sqlalchemy<\/a>,&nbsp;<a href=\"https:\/\/www.statsmodels.org\/stable\/index.html\" target=\"_blank\" rel=\"noopener\">statsmodel<\/a>,&nbsp;<a href=\"https:\/\/www.sympy.org\/en\/index.html\" target=\"_blank\" rel=\"noopener\">sympy<\/a>,&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/latest\/user_install.html#installing-in-classic-jupyter-notebook\" target=\"_blank\" rel=\"noopener\">widgetsnbextension<\/a>,&nbsp;<a href=\"https:\/\/www.python-excel.org\/\" target=\"_blank\" rel=\"noopener\">xlrd<\/a>&nbsp;packages.<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/matplotlib\/ipympl\" target=\"_blank\" rel=\"noopener\">ipympl<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">ipywidgets<\/a>&nbsp;for interactive visualizations and plots in Python notebooks.<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/PAIR-code\/facets\" target=\"_blank\" rel=\"noopener\">Facets<\/a>&nbsp;for visualizing machine learning datasets.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"py-spark\"><strong>PySpark<\/strong><\/h3>\n\n\n\n<p>This Pad is running a Jupyter instance, built off of the&nbsp;<code>jupyter\/pyspark-notebook<\/code>&nbsp;Docker image provided by&nbsp;<a href=\"https:\/\/jupyter-docker-stacks.readthedocs.io\/en\/latest\/using\/selecting.html#jupyter-pyspark-notebook\" target=\"_blank\" rel=\"noopener\">Jupyter Docker Stacks<\/a>. This image includes popular packages from the scientific Python and Apache Spark ecosystems:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/spark.apache.org\/\" target=\"_blank\" rel=\"noopener\">Apache Spark<\/a>&nbsp;with Hadoop binaries<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/grpc\/grpc\/tree\/master\/src\/python\/grpcio_status\" target=\"_blank\" rel=\"noopener\">grpcio-status<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/grpc.io\/docs\/languages\/python\/quickstart\/\" target=\"_blank\" rel=\"noopener\">grpcio<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/arrow.apache.org\/docs\/python\/\" target=\"_blank\" rel=\"noopener\">pyarrow<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/altair-viz.github.io\/\" target=\"_blank\" rel=\"noopener\">altair<\/a>,&nbsp;<a href=\"https:\/\/www.crummy.com\/software\/BeautifulSoup\/\" target=\"_blank\" rel=\"noopener\">beautifulsoup4<\/a>,&nbsp;<a href=\"https:\/\/docs.bokeh.org\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bokeh<\/a>,&nbsp;<a href=\"https:\/\/bottleneck.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">bottleneck<\/a>,&nbsp;<a href=\"https:\/\/github.com\/cloudpipe\/cloudpickle\" target=\"_blank\" rel=\"noopener\">cloudpickle<\/a>,&nbsp;<a href=\"https:\/\/www.openblas.net\/\" target=\"_blank\" rel=\"noopener\">conda-forge::blas=*=openblas<\/a>,&nbsp;<a href=\"https:\/\/cython.org\/\" target=\"_blank\" rel=\"noopener\">cython<\/a>,&nbsp;<a href=\"https:\/\/www.dask.org\/\" target=\"_blank\" rel=\"noopener\">dask<\/a>,&nbsp;<a href=\"https:\/\/pypi.org\/project\/dill\/\" target=\"_blank\" rel=\"noopener\">dill<\/a>,&nbsp;<a href=\"https:\/\/www.h5py.org\/\" target=\"_blank\" rel=\"noopener\">h5py<\/a>,&nbsp;<a href=\"https:\/\/github.com\/jupyterlab\/jupyterlab-git\" target=\"_blank\" rel=\"noopener\">jupyterlab-git<\/a>,&nbsp;<a href=\"https:\/\/matplotlib.org\/\" target=\"_blank\" rel=\"noopener\">matplotlib-base<\/a>,&nbsp;<a href=\"https:\/\/numba.pydata.org\/\" target=\"_blank\" rel=\"noopener\">numba<\/a>,&nbsp;<a href=\"https:\/\/github.com\/pydata\/numexpr\" target=\"_blank\" rel=\"noopener\">numexpr<\/a>,&nbsp;<a href=\"https:\/\/openpyxl.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">openpyxl<\/a>,&nbsp;<a href=\"https:\/\/pandas.pydata.org\/\" target=\"_blank\" rel=\"noopener\">pandas<\/a>,&nbsp;<a href=\"https:\/\/patsy.readthedocs.io\/en\/latest\/\" target=\"_blank\" rel=\"noopener\">patsy<\/a>,&nbsp;<a href=\"https:\/\/protobuf.dev\/getting-started\/pythontutorial\/\" target=\"_blank\" rel=\"noopener\">protobuf<\/a>,&nbsp;<a href=\"https:\/\/www.pytables.org\/\" target=\"_blank\" rel=\"noopener\">pytables<\/a>,&nbsp;<a href=\"https:\/\/scikit-image.org\/\" target=\"_blank\" rel=\"noopener\">scikit-image<\/a>,&nbsp;<a href=\"https:\/\/scikit-learn.org\/stable\/\" target=\"_blank\" rel=\"noopener\">scikit-learn<\/a>,&nbsp;<a href=\"https:\/\/scipy.org\/\" target=\"_blank\" rel=\"noopener\">scipy<\/a>,&nbsp;<a href=\"https:\/\/seaborn.pydata.org\/\" target=\"_blank\" rel=\"noopener\">seaborn<\/a>,&nbsp;<a href=\"https:\/\/www.sqlalchemy.org\/\" target=\"_blank\" rel=\"noopener\">sqlalchemy<\/a>,&nbsp;<a href=\"https:\/\/www.statsmodels.org\/stable\/index.html\" target=\"_blank\" rel=\"noopener\">statsmodel<\/a>,&nbsp;<a href=\"https:\/\/www.sympy.org\/en\/index.html\" target=\"_blank\" rel=\"noopener\">sympy<\/a>,&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/latest\/user_install.html#installing-in-classic-jupyter-notebook\" target=\"_blank\" rel=\"noopener\">widgetsnbextension<\/a>,&nbsp;<a href=\"https:\/\/www.python-excel.org\/\" target=\"_blank\" rel=\"noopener\">xlrd<\/a>&nbsp;packages<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/matplotlib\/ipympl\" target=\"_blank\" rel=\"noopener\">ipympl<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/ipywidgets.readthedocs.io\/en\/stable\/\" target=\"_blank\" rel=\"noopener\">ipywidgets<\/a>&nbsp;for interactive visualizations and plots in Python notebooks<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/PAIR-code\/facets\" target=\"_blank\" rel=\"noopener\">Facets<\/a>&nbsp;for visualizing machine learning datasets<\/li>\n<\/ul>\n\n\n\n<p><strong>Spark UI<\/strong><\/p>\n\n\n\n<p>In order to access the Spark Web UI for an active Spark session you can use the &#8220;Spark UI&#8221; button from the Launcher.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\">\n<p>\u2705 The UI is only available during an active Spark session and takes a few seconds to start up after the start of a job execution.<\/p>\n<\/blockquote>\n\n\n\n<p>If you would like access to the UI after your job has finished, we recommend putting blocking code at the end of your code block like\u00a0<code>input()<\/code> like so:<\/p>\n\n\n<pre class=\"wp-block-code\" aria-describedby=\"shcb-language-1\" data-shcb-language-name=\"Python\" data-shcb-language-slug=\"python\"><span><code class=\"hljs language-python shcb-wrap-lines\"><span class=\"hljs-keyword\">from<\/span> pyspark.sql <span class=\"hljs-keyword\">import<\/span> SparkSession\n\nspark = SparkSession.builder \\\n    .appName(<span class=\"hljs-string\">\"Simple PySpark Example\"<\/span>) \\\n    .getOrCreate()\ndata = &#91;(<span class=\"hljs-string\">\"Alice\"<\/span>, <span class=\"hljs-number\">34<\/span>), (<span class=\"hljs-string\">\"Bob\"<\/span>, <span class=\"hljs-number\">45<\/span>), (<span class=\"hljs-string\">\"Catherine\"<\/span>, <span class=\"hljs-number\">29<\/span>)]\ncolumns = &#91;<span class=\"hljs-string\">\"Name\"<\/span>, <span class=\"hljs-string\">\"Age\"<\/span>]\ndf = spark.createDataFrame(data, schema=columns)\ndf_with_age_plus_ten = df.withColumn(<span class=\"hljs-string\">\"AgePlusTen\"<\/span>, df&#91;<span class=\"hljs-string\">\"Age\"<\/span>] + <span class=\"hljs-number\">10<\/span>)\ndf_with_age_plus_ten.show()\n\ninput() <span class=\"hljs-comment\"># block execution so that you can access the Spark UI<\/span>\n\nspark.stop()<\/code><\/span><small class=\"shcb-language\" id=\"shcb-language-1\"><span class=\"shcb-language__label\">Code language:<\/span> <span class=\"shcb-language__name\">Python<\/span> <span class=\"shcb-language__paren\">(<\/span><span class=\"shcb-language__slug\">python<\/span><span class=\"shcb-language__paren\">)<\/span><\/small><\/pre>\n\n\n<h2 class=\"wp-block-heading\" id=\"real-time-collaboration\">Real Time Collaboration<\/h2>\n\n\n\n<p>We&#8217;ve included the&nbsp;<code>jupyter-collaboration<\/code>&nbsp;extension, which allows for multiple users to edit and interact with a notebook at the same time. Note: currently, all users are anonymously named in Jupyter, but we hope to fix this soon!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"container-limits\">Container Limits<\/h2>\n\n\n\n<p>The container running your application has a few limitations. Currently, we don&#8217;t limit your CPU usage, though this may change in future. In addition to CPU, we monitor the network bandwidth that is consumed, and limit you to 75mb for the duration of the container. Finally, we limit the amount of memory accessible to each container to 0.5 GB.<\/p>\n\n\n\n<p>Are there any libraries or settings we missed? Feel free to&nbsp;<a href=\"mailto:support@coderpad.io?subject=CoderPad%20Language%20Suggestion\">email us<\/a>&nbsp;with suggestions!<\/p>\n","protected":false},"parent":835,"menu_order":0,"template":"","class_list":["post-35575","doc","type-doc","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/doc\/35575","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/doc"}],"about":[{"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/types\/doc"}],"version-history":[{"count":24,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/doc\/35575\/revisions"}],"predecessor-version":[{"id":40787,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/doc\/35575\/revisions\/40787"}],"up":[{"embeddable":true,"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/doc\/835"}],"wp:attachment":[{"href":"https:\/\/coderpad.io\/wp-json\/wp\/v2\/media?parent=35575"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}