4/9 Research Software Engineering with Python (COMP0233) - Data Formats

Testing your software is part of development. In this episode I talk about different types of testing, automated tests, legacy code etc. My guest is Stef Piatek from UCL who tells us how he approaches testing in his daily work.Linkshttps://docs.python.org/3/library/unittest.htmlhttps://docs.pytest.org/https://docs.pytest.org/en/stable/how-to/monkeypatch.html PyTest Monkeypatchhttps://agiledata.org/essays/tdd.html test driven development TDDhttps://en.wikipedia.org/wiki/Extreme_programminghttps://joss.readthedocs.io/en/latest/review_criteria.html criteria for open source software reviews, which includes a section on testinghttps://www.freecodecamp.org/news/a-practical-guide-to-start-opensource-contributions/https://docs.github.com/en/actions GitHub Actionshttps://martinfowler.com Martin Fowler's great web site. Also look out for his book:Working Effectively With Legacy Code - Michael Feathers, 2004, ISBN: 8601400968741Don't be shy - say HiThis podcast is brought to you by the Advanced Research Computing Centre of the University College London, UK. Producer and Host: Peter Schmidt

In this episode I'll be discussing data formats such as CSV, JSON and YAML. My guest is Nick Radcliffe from Stochastic Solutions and the Uni. Edinburgh. Nick's expertise is in data science and he has a lot to share about data, data formats and how to use them.Linkshttps://www.linkedin.com/in/njradcliffe/ Nick's LinkedIn profilehttps://en.wikipedia.org/wiki/Comma-separated_values CSV formatshttps://www.json.org/json-en.html JSONhttps://json-ld.org JSON for linked datahttps://json-schema.org JSON schemahttps://yaml.org YAMLhttps://parquet.apache.org Parquet by Apachehttps://hdfgroup.github.io/hdf5/ HDF5Librarieshttps://numpy.orghttps://scipy.orghttps://scikit-learn.org/stable/http://www.tdda.info test driven data analysisDon't be shy - say HiThis podcast is brought to you by the Advanced Research Computing Centre of the University College London, UK. Producer and Host: Peter Schmidt

Python is one of the most widely used programming languages in research and science. How did it come to that. And what makes Python special? It's something I discuss with my guest in this episode, Robin Wilson, who also takes us through some of the less favourable or more complex aspects of the language.Linkshttp://www.rtwilson.com Robert Wilsonhttps://blog.rtwilson.com Robert's blog postshttps://www.python.orghttps://anaconda.org Anaconda Python distributionhttps://jupyter.org all things Jupyterhttps://ipython.org iPythonhttps://inference-review.com/article/the-origins-of-pythonhttps://en.wikipedia.org/wiki/Literate_programmingPython libraries for sciencehttps://numpy.org https://scipy.org https://pandas.pydata.orghttps://scikit-learn.org/stable/Don't be shy - say HiThis podcast is brought to you by the Advanced Research Computing Centre of the University College London, UK. Producer and Host: Peter Schmidt

In this episode we look into more essential Git commands, such as branching and merging. Branching and merging are key concepts that help you develop code or even text documents in a team. They help you maintain different versions of files and work on them independently.Another element of collaborative working is provided by GitHub: the pull request. Pull request are a great way to do code reviews, which avoids introducing bugs and also learn from each other.In my conversations Sam and Eirini talk about these key features and their experiences with it.Links:https://git-scm.com/ Git againhttps://martinfowler.com/articles/branching-patterns.html Martin Fowler's blog post on branching patternshttps://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/about-pull-requests explains the mechanics of pull requests in more detailhttps://github-pages.ucl.ac.uk/rsd-engineeringcourse/ Lecture notesDon't be shy - say HiThis podcast is brought to you by the Advanced Research Computing Centre of the University College London, UK. Producer and Host: Peter Schmidt

Peter Schmidt - the host of this podcast - interviews Sam Harrison, an environmental modeller at the UK Centre for ecology and hydrology. Is it version control important for his research? what tool does he use? How he learn it? Links and transcript available in the show notes.About Samhttps://www.ceh.ac.uk/staff/samuel-harrisonhttps://www.ceh.ac.uk/About Githttps://git-scm.com/https://github.com/git/git/https://github.com/git/git/tree/v0.99 (almost) first version of Git from 2005https://github-pages.ucl.ac.uk/rsd-engineeringcourse/ Lecture notesDon't be shy - say HiThis podcast is brought to you by the Advanced Research Computing Centre of the University College London, UK. Producer and Host: Peter Schmidt