axios is a popular JavaScript library that allows you to make HTTP requests from a Node.js environment.
It is a promise-based library that works in both the browser and Node.js.
It is similar to the Fetch API, but with a more powerful feature set and better browser compatibility.
One of the main benefits of using axios is that it automatically transforms the response data into a JSON object,
making it easy to work with.
Axios is known for user-friendly API and support for asynchronous async/await syntax making it very accessible in web scraping.
Primp is a Python HTTP client that impersonates real web browsers by replicating their
TLS fingerprints, HTTP/2 settings, and header ordering. It is a lightweight alternative
to curl-cffi for bypassing TLS and HTTP fingerprinting-based bot detection.
Key features include:
- Browser impersonation
Can impersonate Chrome, Firefox, Safari, Edge, and OkHttp clients by replicating their
exact TLS fingerprints (JA3/JA4), HTTP/2 frame settings, header ordering, and other
connection-level characteristics.
- HTTP/2 support
Full HTTP/2 support with configurable settings that match real browser behavior.
- Lightweight
Smaller and simpler than curl-cffi while providing similar impersonation capabilities.
Built on Rust for performance.
- Familiar API
Provides a requests-like API with Session support, making it easy to adopt for
developers familiar with the Python requests library.
- Proxy support
HTTP and SOCKS5 proxy support with authentication.
- Cookie management
Automatic cookie handling across requests within a session.
Primp fills a similar niche to curl-cffi and hrequests — HTTP clients designed to avoid
TLS/HTTP fingerprinting — but takes a Rust-powered approach for better performance. It is
particularly useful when you need to bypass bot detection that relies on connection-level
fingerprinting without using a full browser.
```javascript
// axios can be used with promises:
axios.get('http://httpbin.org/json')
.then(response => {
console.log(response.data);
})
.catch(error => {
console.log(error);
});
// or async await syntax:
var resp = await axios.get('http://httpbin.org/json');
console.log(resp.data);
// to make requests concurrently Promise.all function can be used:
const results = await Promise.all([
axios.get('http://httpbin.org/html'),
axios.get('http://httpbin.org/html'),
axios.get('http://httpbin.org/html'),
])
// axios also supports other type of requests like POST and even automatically serialize them:
await axios.post('http://httpbin.org/post', {'query': 'hello world'});
// or formdata
const data = {name: 'John Doe', email: 'johndoe@example.com'};
await axios.post('https://jsonplaceholder.typicode.com/users',
querystring.stringify(data),
{
headers: {
'Content-Type': 'application/x-www-form-urlencoded'
}
}
);
// default values like headers can be configured globally
axios.defaults.headers.common['User-Agent'] = 'webscraping.fyi';
// or for session instance:
const instance = axios.create({
headers: {"User-Agent": "webscraping.fyi"},
})
```
```python
import primp
# Create a session that impersonates Chrome
session = primp.Session(impersonate="chrome_131")
# Make requests - TLS fingerprint matches real Chrome
response = session.get("https://example.com")
print(response.status_code)
print(response.text)
# POST with JSON data
response = session.post(
"https://api.example.com/data",
json={"key": "value"},
)
# With proxy
session = primp.Session(
impersonate="firefox_133",
proxy="http://user:pass@proxy.example.com:8080",
)
response = session.get("https://example.com")
# Different browser impersonation profiles
for browser in ["chrome_131", "firefox_133", "safari_18", "edge_131"]:
session = primp.Session(impersonate=browser)
resp = session.get("https://tls.peet.ws/api/all")
print(f"{browser}: {resp.json()['ja3_hash']}")
```