Tag Archives: python

How-to: Scrape Data with Python’s BeautifulSoup

Hello. In this post I’ll show how to scrape semi-structured data from a target webpage with Python’s BeautifulSoup module. BeautifulSoup is indeed beautiful. It is the go-to package for scraping data and working with HTML. We’ll also use requests to grab the HTML from the target URL. The page I use in my example should… Read More »

How to setup IPython for Python 2.7 and 3+ kernels

IPython is an interactive notebook that is accessed from your browser. It is extremely useful because it is designed with code sharing in mind, supports up to 49 different languages/versions of languages, and has “cells”, or blocks of code that are interpreted one at a time (or all at once). Another reason to use IPython… Read More »

How to Scrape Data from Webpages with Python’s Scrapy

In this post I’ll show how to gather unstructured information that exists on webpages using Python’s open source web crawling framework, Scrapy. Web crawlers have been around since the conception of the internet, in fact Google started out by visiting links from Stanford’s homepage until all 10 million of them had been explored. In the… Read More »

Statistical Programming with R and Python

R and Python are two popular languages for those who want to do data analysis. In this post, I will cover some libraries, packages and resources that will help you quickly learn how to become proficient with these statistical and scripting languages. This post is intended for the beginner-intermediate level, though you may find some… Read More »

How to Learn Python Fast

Python is often recommended as a first programming language to beginners because of how fast and easy it is to write and execute code. Simplicity is literally built into it, and it isn’t uncommon to be able to write a 10-15 line function from other languages in 5 lines or less with Python. In addition… Read More »

Rename files, folders, and their contents. With Python.

Ever had a hopelessly disorganized folder that doesn’t follow a specific format? Well, you can put together a script to rename all the files entirely and add a number to the end (or something to that effect), but you lose key identifying information contained in the filename e.g., “MyFirstHomeVid.avi” So what I did was create… Read More »