The essence of a crawler is to capture valuable data from the target websites. Therefore, every website will more or less adopt some anti crawler technology to prevent crawlers. For example, the user-agent request header is used to verify whether it is a browser, and JavaScript is used to load resources dynamically. These are the […]
How To Bypass Anti Web Crawler In Scrapy Project Read More »
This article introduces how to use the Python XLWT library to generate excel spreadsheet tables and export the excel file to HTTP client in Django.
Django Create And Export Excel Files With XLWT Example Read More »
This article will tell you how to use the Python requests module to retrieve a web page content by page URL and then save the web page content to a local file step by step.
Python Save Html File From Url Example Read More »
Scrapy is a Python library that can be used to crawl web pages and extract the web page elements by XPath or CSS selector in python code. This article will tell you how to create a Scrapy project and how to implement the Scrapy related classes in the project to crawl and extract a job
How To Create Scrapy Project To Crawl Web Page Example Read More »
In this article, I will tell you several methods about how to use python os, pathlib module to list files in directory. It will also tell you how to use the python fnmatch module to filter out special files that match the file name pattern.
Python List Files In Directory Example Read More »
Mac OS X has installed python by default, but the version is 2.7.10. It is a little older, so I upgrade python to a newer version ( python 3.7 or python 3.9 ). But after installing the new version, when I open a terminal and run python command, it still uses Python 2.7. This article
Installed Python 3 On Mac OS X But It Still Use Python 2.7 Read More »
In this article I will tell you how to use the python openpyxl library to freeze excel sheet rows and columns, it also tells you how to split excel sheets into multiple panes with examples.
How To Use Python Openpyxl To Freeze Excel Rows Columns And Split Panes Read More »
In this article, I will tell you how to use the python openpyxl library to copy one excel sheet data to another excel sheet, the two excel sheets can be in the same excel file or different excel file. If you do not know the openpyxl library, you can read the article How To Create
How To Use Python Openpyxl To Copy Excel Sheet Data In Same And Different Excel File Read More »
In this article, I will show you how to use python library openpyxl to easily create an excel workbook, add a worksheet to the workbook, insert cell data and save the workbook object to a local excel file. It will also show you how to read a local excel file and load all the excel
How To Create / Load Excel File In Python Using Openpyxl Read More »
In this article, i will show you how to use python regular expression module ( python re module ) to parse a string to return the first matched string and all matched strings.
How To Find First And All Matched String Use Python Regex Pattern Object Read More »