Amazon is an Ecommerce giant and the biggest company on earth in terms of market value. One can find almost anything and everything on Amazon. With advancing technology and lifestyle changes Amazon has become the go to destination for any kind of shopping. Similar Ecommerce businesses always need the bulk product data from Amazon as it contains huge source. So they require some automated task like Amazon scraping for updated data collection.
In this tutorial we will go to Amazon.com and scrape a products data from there. There are millions of products, and there is tb’s of data available related to those products on Amazon. This data can be used in numerous ways such as to can keep track of a product’s price and buy it when it drops to ideal level, track products availability. In case you are an area seller , it allows you to keep track of prices posted by other sellers and change your price accordingly, an ecom competitor can track product pricing and change accordingly. We can scrape customer reviews and ratings about a product and do a business analysis and much more.
There are numerous application with the enormous amount of data that amazon houses. It is essential to know how we can grab this data that could be applied for diverse needs. So, let’s learn about Amazon scraping.
In this tutorial we will go to this amazon page https://www.amazon.com/Lacoste-Carnaby-Sneaker-White-Medium/dp/B07T5Q2VLG?s=shopbop&ref_=sb_ts and scrape the details of this Lacoste shoes like Price, Name, Ratings, Color options etc.
See detailed code below and watch the video for more details:
#import libraries
from urllib.request import urlopen
from bs4 import BeautifulSoup as soup
import requests
#set headers
header = {'user-agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36','Referer':'https://www.amazon.com/stores/page/0B6B05F4-EE4D-4696-A789-BB7152AB8DCE?ingress=0&visitId=9365015c-39f1-4f05-8ec9-61dfafb3a84a&channel=SB-gway&liveVideoDataUrl=https%3A%2F%2Famazonlive-portal.amazon.com%2Fv2&ref_=sb_w_i_ctcd_snkrs&productGridPageIndex=4'}
#Define URL and send get request
url = 'https://www.amazon.com/Lacoste-Carnaby-Sneaker-White-Medium/dp/B07T5Q2VLG?s=shopbop&ref_=sb_ts'
html = requests.get(url,headers=header)
#Create BeautifulSoup object
bsobj = soup(html.content,'lxml')
#Brand Name
bsobj.findAll('div',{'class':'a-section a-spacing-none'})[0].a.text
#product name
bsobj.h1.text.strip()
#Ratings
bsobj.findAll('i',{'class':'a-icon a-icon-star a-star-3'})[0].text
#Price
bsobj.findAll('table',{'class':'a-lineitem'})[0].tr.span.text
#Shoe Size
for a in bsobj.findAll('span',{'class':'a-dropdown-container'})[0].findAll('option')[1:]:
print(a.text.strip())
#Shoe Color
colors =[]
for a in range(0,6):
name = 'color_name_' + str(a)
colors.append(name)
for color in bsobj.findAll('li',{'id':colors}):
print(color.img['alt'])Meanwhile, you can use our product scraping services for millions of data extraction from amazon. Once download sample data of our Amazon data scraper. No need of any coding, just contact us for your data need. We have experience in scraping lakhs of data from Amazon on daily basis.
