Pewtils is a package of useful programming utilities developed at the Pew Research Center over the years. Most of the functions in Pewtils can be found in the root module, while a handful of submodules contain more specialized utilities for working with files, web resources, and regular expressions.
To install, you can use pip:
pip install git+https://github.com/pewresearch/pewtils#egg=pewtils
Or you can install from source:
git clone https://github.com/pewresearch/pewtils.git
cd pewtils
python setup.py install
Some of our libraries require the use of 64-bit Python. If you encounter errors during installation that are related to missing libraries, you may be using 32-bit Python. We recommend that you uninstall this version and switch to a 64-bit version instead. On Windows, these will be marked with x86-64; you can find the latest 64-bit versions of Python here.
ssdeep is an optional dependency that can be used by the get_hash function in Pewtils. Installation instructions for various Linux distributions can be found in the library's documentation. The ssdeep Python library is not currently compatible with Windows. Installing ssdeep on Mac OS may involve a few additional steps, detailed below:
- Install Homebrew
- Install xcode
xcode-select --install - Install system dependencies
brew install pkg-config libffi libtool automake ln -s /usr/local/bin/glibtoolize /usr/local/bin/libtoolize - Install ssdeep with an additional flag to build the required libraries
BUILD_LIB=1 pip install ssdeep - If step 4 fails, you may need to redirect your system to the new libraries by setting the following flags:
Do this and try step 4 again.
export LIBTOOL=`which glibtool` export LIBTOOLIZE=`which glibtoolize` - Now you should be able to run the main installation process detailed above.
Please refer to the official documentation for information on how to use this package.
In addition to the license, Users must abide by the following conditions:
- User may not use the Center's logo
- User may not use the Center's name in any advertising, marketing or promotional materials.
- User may not use the licensed materials in any manner that implies, suggests, or could otherwise be perceived as attributing a particular policy or lobbying objective or opinion to the Center, or as a Center endorsement of a cause, candidate, issue, party, product, business, organization, religion or viewpoint.
This code is provided as-is for use in your own projects. You are free to submit issues and pull requests with any questions or suggestions you may have. We will do our best to respond within a 30-day time period.
Pew Research Center, 2020, "pewtils" Available at: github.com/pewresearch/pewtils
The following authors contributed to this repository:
- Patrick van Kessel
- Regina Widjaya
- Skye Toor
- Emma Remy
- Onyi Lam
- Brian Broderick
- Galen Stocking
- Dennis Quinn
Pew Research Center is a nonpartisan fact tank that informs the public about the issues, attitudes and trends shaping the world. It does not take policy positions. The Center conducts public opinion polling, demographic research, content analysis and other data-driven social science research. It studies U.S. politics and policy; journalism and media; internet, science and technology; religion and public life; Hispanic trends; global attitudes and trends; and U.S. social and demographic trends. All of the Center's reports are available at www.pewresearch.org. Pew Research Center is a subsidiary of The Pew Charitable Trusts, its primary funder.
For all inquiries, please email [email protected]. Please be sure to specify your deadline, and we will get back to you as soon as possible. This email account is monitored regularly by Pew Research Center Communications staff.