Category Archives: python

How to Get Started with Django Properly (for free!)

Recently I gave Python’s Django a try. Django is a free and open source web framework that allows for the quick creation of any kind of website, ranging from blogs to stores to Git server front-end. Django is extensible and has thousands of modules or “packages”.  One of the best things about this project is the abundance… Read More »

Close Encounter with Vendor Lock-in, Python Triumphs

Vendor lock-in is a term that refers to the practice of a company making a customer dependent (but not entirely) on their goods or services. In IT circles, I hear Cisco’s name thrown around a lot with references to “building a moat“. Some other examples of this are: the patented K-Cup brewing system of Kuerig, printer… Read More »

Retrieval-based Deep Learning with TensorFlow v1.0+ and Python

Hi there. In this post I will cover code from a Github repo that I forked (detailed in this post) that trains a machine learning model based on IRC chat logs (the Ubuntu Dialog Corpus) to select the correct response out of a set of potential responses, given a context. The code was created last year with… Read More »

Cleaning Transcript Data with Python

Performing an analysis of text data or using text data to train machine learning models oftentimes requires a lot of data. Usually people look to Wikipedia for large amounts of text data, but occasionally scholars will make use of less traditional sources of data, like movie reviews for performing sentiment analysis on sentences or Ubuntu IRC chat… Read More »

How to write CSV data to a SQLite database with Python

In this short post I will show the syntax for writing data to a SQL database with the Python library, sqlite3. We will be using Python 3+. A SQLite database is exactly what it sounds like – a lightweight implementation of the popular SQL relational database management system, making it perfect for browsers, embedded systems,… Read More »

How-to: Scrape Data with Python’s BeautifulSoup

Hello. In this post I’ll show how to scrape semi-structured data from a target webpage with Python’s BeautifulSoup module. BeautifulSoup is indeed beautiful. It is the go-to package for scraping data and working with HTML. We’ll also use requests to grab the HTML from the target URL. The page I use in my example should… Read More »

How to setup IPython for Python 2.7 and 3+ kernels

IPython is an interactive notebook that is accessed from your browser. It is extremely useful because it is designed with code sharing in mind, supports up to 49 different languages/versions of languages, and has “cells”, or blocks of code that are interpreted one at a time (or all at once). Another reason to use IPython… Read More »

How to Scrape Data from Webpages with Python’s Scrapy

In this post I’ll show how to gather unstructured information that exists on webpages using Python’s open source web crawling framework, Scrapy. Web crawlers have been around since the conception of the internet, in fact Google started out by visiting links from Stanford’s homepage until all 10 million of them had been explored. In the… Read More »