Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 46 additions & 0 deletions .ipynb_checkpoints/README-checkpoint.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
![IronHack Logo](https://s3-eu-west-1.amazonaws.com/ih-materials/uploads/upload_d5c5793015fec3be28a63c4fa3dd4d55.png)

# Project: API and Web Data Scraping

## Overview

The goal of this project is for you to practice what you have learned in the APIs and Web Scraping chapter of this program. For this project, you will choose both an API to obtain data from and a web page to scrape. For the API portion of the project will need to make calls to your chosen API, successfully obtain a response, request data, convert it into a Pandas data frame, and export it as a CSV file. For the web scraping portion of the project, you will need to scrape the HTML from your chosen page, parse the HTML to extract the necessary information, and either save the results to a text (txt) file if it is text or into a CSV file if it is tabular data.

**You will be working individually for this project**, but we'll be guiding you along the process and helping you as you go. Show us what you've got!

---

## Technical Requirements

The technical requirements for this project are as follows:

* You must obtain data from an API using Python.
* You must scrape and clean HTML from a web page using Python.
* The results should be two files - one containing the tabular results of your API request and the other containing the results of your web page scrape.
* Your code should be saved in a Jupyter Notebook and your results should be saved in a folder named output.
* You should include a README.md file that describes the steps you took and your thought process for obtaining data from the API and web page.

## Necessary Deliverables

The following deliverables should be pushed to your Github repo for this chapter.

* **A Jupyter Notebook (.ipynb) file** that contains the code used to work with your API and scrape your web page.
* **An output folder** containing the outputs of your API and scraping efforts.
* **A ``README.md`` file** containing a detailed explanation of your approach and code for retrieving data from the API and scraping the web page as well as your results, obstacles encountered, and lessons learned.

## Suggested Ways to Get Started

* **Find an API to work with** - a great place to start looking would be [API List](https://apilist.fun/) and [Public APIs](https://github.com/toddmotto/public-apis). If you need authorization for your chosen API, make sure to give yourself enough time for the service to review and accept your application. Have a couple back-up APIs chosen just in case!
* **Find a web page to scrape** and determine the content you would like to scrape from it - blogs and news sites are typically good candidates for scraping text content, and [Wikipedia](https://www.wikipedia.org/) is usually a good source for HTML tables (search for "list of...").
* **Break the project down into different steps** - note the steps covered in the API and web scraping lessons, try to follow them, and make adjustments as you encounter the obstacles that are inevitable due to all APIs and web pages being different.
* **Use the tools in your tool kit** - your knowledge of intermediate Python as well as some of the things you've learned in previous chapters. This is a great way to start tying everything you've learned together!
* **Work through the lessons in class** & ask questions when you need to! Think about adding relevant code to your project each night, instead of, you know... _procrastinating_.
* **Commit early, commit often**, don’t be afraid of doing something incorrectly because you can always roll back to a previous version.
* **Consult documentation and resources provided** to better understand the tools you are using and how to accomplish what you want.

## Useful Resources

* [Requests Library Documentation: Quickstart](http://docs.python-requests.org/en/master/user/quickstart/)
* [BeautifulSoup Documentation](https://www.crummy.com/software/BeautifulSoup/bs4/doc/)
* [Stack Overflow Python Requests Questions](https://stackoverflow.com/questions/tagged/python-requests)
* [StackOverflow BeautifulSoup Questions](https://stackoverflow.com/questions/tagged/beautifulsoup)
119 changes: 119 additions & 0 deletions .ipynb_checkpoints/output-checkpoint.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,119 @@
index,href,Description,Color,Model,Size,Body Wood,Body Finish,Body Colors,Bridge,Scale Length,Neck Radius,Headstock Size,Frets,Neck Width,Neck Wood,Fingerboard,Fret Markers,Neck Finish,Neck Colors,Tuning Machines,Truss Rod,Neck Attachment,Electronic Shielding,Controls,Switching,Pickups,Left Handed,Strings,Pickguard,Order,Neck Binding,Body Bindings
StingRay 5 35th Anniversary,basses/stingray-5-35th-anniversary,"
In 1987 Ernie Ball Music Man created the legendary StingRay 5 bass, setting the standard for the modern 5-string bass. The 35th Anniversary edition honors the timeless Ernie Ball Music Man design that has been used by some of the world’s most iconic bassists. The ash body features a spalted maple top with thin maple veneer and comes standard with a Spalted Sunburst finish. The roasted figured maple neck features an ebony fretboard, copper pearlescent block inlays and is finished in a high gloss for superb comfort and playability. High-output neodymium StingRay 5 pickups provide powerful low-end with a distinctive mid-range punch while the lightweight hardware delivers solid stability. Limited to 225 single-humbucker and 25 dual-humbucker models, every Anniversary StingRay 5 includes a certificate of authenticity.
","



Spalted Sunburst



",StingRay 5 35th Anniversary,"13-3/8"" wide, 1-3/4"" thick, 45-3/4"" long (34.0 cm wide, 4.5 cm thick, 116.2 cm long)",Ash,High gloss polyester,Spalted Sunburst,"Standard - Music Man® Black plated, hardened steel bridge plate with stainless steel saddles","34"" (86.4 cm)","11"" (27.9 cm)","Only 9"" (22.9 cm) long","22 - High profile, wide, Stainless Steel","1-3/4"" (44.5 mm) at nut 2-3/4"""" (69.9 mm) at last fret",Select roasted maple,Ebony ,Copper Pearloid Atlante Blocks,High gloss polyester,Natural,"Custom Music Man, lightweight with tapered string posts and ergonomic clover design",Adjustable - no component or string removal,"5 bolt, sculpted neck joint",Graphite acrylic resin coated body cavity and aluminum control cover,"3-band active preamp with 18 volts of headroom; vol, treble, mid, bass",H: 3-way lever pickup selector; HH: 5-way lever pickup selector,Single or Dual Humbucking with Neodymium Magnets,No,46w-65w-80w-100w-130w (Regular Slinky Bass #2836),,,,
StingRay Special Collection,families/basses/stingray-special,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
Short Scale StingRay,basses/short-scale-stingray,"
The Ernie Ball Music Man Short Scale StingRay bass offers a big thumpy round sound in a convenient smaller package. A 30” scale allows for easier playability due to the shorter spacing between the frets. The Ernie Ball Music Man passive humbucking pickup, equipped with higher output neodymium magnets, has been specially designed for the short scale bass, providing its signature warm tone. The electronics package includes a 3-way rotary switch featuring parallel, true single-coil, and series modes. Like its big brother, the Stingray Special, the short scale bass comes standard with a modern classic bridge, 22 stainless steel frets, and new lightweight Music Man tuning machines with a finer gear ratio.
","



Candy Man






Burnt Ends






Vincent Blue






Silver Shadow






Plum Crazy



",Short Scale StingRay Bass,"12-3/8"" wide, 1-5/8"" thick, 40-7/8"" long (31.4 cm wide, 4.1 cm thick, 103.8 cm long)",Ash,High gloss polyester,,"Vintage Music Man® top loaded chrome plated, steel bridge plate with vintage nickel plated steel saddles","30"" (76.2 cm)",,,"22 - High profile, wide stainless steel","1-1/2"" (38.1 mm) at the nut, 2-3/8"" (60.3 cm) at the last fret",Select Maple,,"5/16"" Dot Inlay",Gunstock oil and hand-rubbed special wax blend,,"Custom Music Man, lightweight with tapered string posts and ergonomic clover design",Adjustable - no component or string removal,"5 bolt, sculpted neck joint",Chrome plated aluminum control cover,"Passive 500kohm push/push volume POT for gain boost, 100kohm tone POT - 0.1uf tone cap",3-way rotary pickup selector ,Single Music Man humbucking pickup- neodymium magnets,No,45w-65w-85w-105w (Short Scale Regular Slinky Bass #2852),,,,
DarkRay,families/basses/darkray,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
Joe Dart Collection,families/basses/joe-dart,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
Tim Commerford,basses/tim-commerford,"
Welcome to the Tim Commerford Artist Series StingRay collection. These brand-new limited-edition Ernie Ball Music Man instruments were designed in conjunction with Tim Commerford, the legendary bassist of Rage Against the Machine, Audioslave, and his newest project, 7D7D. Tim has been a part of the Ernie Ball Music Man family for many years, and this collaboration is the natural evolution of his enduring passion for the StingRay bass. With active and passive options for both short-scale and full-scale, you’re sure to find the right match for your playing style. The passive full-scale and active short-scale models deserve special consideration, as Music Man has never before offered these configurations.

Over the last 30 years, Commerford has perfected his signature sound, playing many passive and active basses. The ability to have both full and short-scale, active and passive basses in one collection gives Tim the tools required to reproduce the sounds made famous throughout his career.
","



Black Full-Scale (Active)






Natural Full-Scale (Passive)



",Tim Commerford Active Short-Scale,"12-3/8"" wide, 1-5/8"" thick, 40-7/8"" long (31.4 cm wide, 4.1 cm thick, 103.8 cm long)",Ash,High gloss polyester,Natural Gloss,"Music Man® chrome plated, strings-thru-the-body & hardened steel bridge plate with vintage nickel plated steel saddles and adjustable mute pads","30"" (76.2 cm)","11"" (27.9 cm)","8"" (20.3 cm) long","22 - High profile, wide stainless steel","1-1/2"" (38.1 mm) at the nut, 2-3/8"" (60.3 cm) at the last fret",Select Maple,Maple,"5/16"" Dot Inlay",Gunstock oil and hand-rubbed special wax blend,,"Custom Music Man, lightweight with tapered string posts and ergonomic clover design",,"5 bolt, sculpted neck joint",Chrome plated aluminum control cover,"3-band active preamp with 18 volts of headroom; vol, treble, mid, bass",,Single Humbucking with Neodymium magnets,,45w-65w-85w-105w (Medium Scale Regular Slinky Bass #2856),Black,,,
Bongo Collection,families/basses/bongo,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
John Myung,basses/john-myung,"
The John Myung artist series Bongo is a sleek, ultra-modern 6 string bass crafted and perfected to John's exacting specifications.
With over a decade long refinement process, John and the Ernie Ball Music Man engineering team have addressed a multitude of design features to further enhance comfortability, playability, and overall performance. Some key features include a simplified control layout with preprogrammed equalization, a perfectly balanced compact basswood body mated to a maple neck with 5 string nut width for tighter string spacing, and a golden ratio fretboard utilizing a combination of rosewood and roasted maple for an elegant aesthetic. This instrument is truly an artist inspired design that facilitates John's needs as a performance artist and master technician.
","



Platinum Silver






Black



",John Myung Bongo 6 HH,"12-3/4"" wide, 1-5/8"" thick, 47-5/8"" long (32.4 cm wide, 4.1 cm thick, 121.0 cm long)",Basswood,High gloss polyester,Black,"Music Man® chrome plated, steel bridge plate with stainless steel saddles","34"" (86.4 cm)","11"" (27.9 cm)","Only 9-3/4"" (24.8 cm) long","24 - High profile, wide","1-3/4"" (44.5 mm) at nut 2-13/16"" (71.4 mm) at last fret",Roasted Maple Neck,Rosewood/Roasted Maple,White Half moon inlay,Oil and Wax,Natural,"Custom Music Man, lightweight with tapered string posts and ergonomic design",,"5 bolt, sculpted neck joint",Graphite acrylic resin coated body cavity and aluminum control cover,Volume,5-way pickup blend knob,Dual Humbucking with Neodymium magnets,No,32w-45w-65w-80w-100w-130w (Cobalt Bass),Black,1,N/A,
Mike Herrera,basses/mike-herrera,"
Introducing the Ernie Ball Music Man Mike Herrera StingRay bass. For more than two decades MXPX frontman and bassist Mike Herrera has wielded a custom StingRay, modified to his unique specifications. Now, Herrera’s secret weapon is available to the public. The Mike Herrera StingRay features an ash body with Seafoam Green finish, a matching headstock, an engraved white pearloid pickguard, passive electronics (no battery required), and a custom laser engraved Artist Series neckplate. Having the appearance of a traditional 2-band EQ StingRay, the Herrera StingRay's pickup is actually wired straight to the jack with three dummy knobs. Additional features include a maple neck and fretboard, 21 nickel frets, six bolt neck, and alnico magnets.
","



Seafoam Green



",Mike Herrera StingRay Bass,"13-1/2"" wide x 1-5/8"" thick x 44-7/8"" long (34.3 cm wide, 4.1 cm thick, 114.0 cm long)",Ash,High gloss polyester,Seafoam Green,"Music Man® Chrome plated, hardened steel bridge plate with stainless steel saddles","34"" (86.4 cm)","11"" (27.9 cm)",,"21 high profile wide, nickel silver","1-11/16"" (42.9mm) at nut, 2-1/2"" (63.5 mm) at last fret",Maple,Maple,Dot inlay,Gunstock oil and hand-rubbed special wax blend,Natural,"Schaller BM, with tapered string posts",,6 bolts - perfect alignment with no shifting,,"3 dummy knobs, pickup wired directly to jack",,Music Man® humbucking with Alnico magnets,no,50w-70w-85w-105w (Regular Slinky Bass #2832),"Engraved White Pearloid, 3-ply with black center layer",,,
Sterling Collection,families/basses/sterling,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
Cliff Williams,basses/cliff-williams,"
The all-new Cliff Williams Icon Series StingRay Bass is the first in a series of limited handcrafted replicas made to capture the look, sound, and essence of iconic Music Man instruments. Initially dubbed “The #1 Workhorse,” Cliff's 1979 Stingray has been his favorite bass for more than 40 years. Built to the exacting specifications of his original, every detail and characteristic was carefully examined and addressed. Body contours, neck carve, pickup construction, and decades of wear and tear were dutifully replicated by Music Man’s team of master craftsmen. The resulting outcome is a finely crafted period-correct instrument that looks, feels, and sounds just like Cliff’s #1 Stingray bass.
Only 26 available worldwide.
Listen to our podcast episode with Cliff Williams and Ernie Ball Music Man engineer Blair Ridings.
","



Back in Burst



",Cliff Williams StingRay,"13-1/2"" wide x 1-5/8"" thick x 44-7/8"" long (34.3 cm wide, 4.1 cm thick, 114.0 cm long)",3-Piece Trans Poplar,Nitrocellulose Lacquer,Back in Burst,"Pre-EB Geometry Music Man® chrome plated, steel bridge plate with vintage stainless steel saddles","34"" (86.4 cm)","7.5"" (19.1 cm)","8-3/4"" (22.2 cm) long","21 - Low profile, wide","2-1/2"" (63.5 mm)",Select maple neck,Natural aged light yellow finish,"5/16"" Dot Inlay",Nitrocellulose Lacquer,Natural aged light yellow finish,"Schaller BM, with tapered string posts",,"3 Bolt, Pre EB Music Man Design with Micro-Tilt Neck Shim Adjustment",Chrome plated brass control cover & Copper Insulating Tape in Control Cavity,"Custom 2-band active preamp; vol, treble, bass",,Custom humbucking with 8 elongated Alnico magnets,No,50w-70w-85w-105w (Group II Flatwound #2804),N/A,,N/A,N/A
Loading