Tools & Integrations

Integration

  • How can I use Proxy credentials type: http://host:port || IP:PORT ?

    In case you are using software that can accept only IP:PORT and not accept IP:PORT USERNAME:PASSWORD - you will need to use an additional tool.In order to remove the user name password section from the request, please use the Brigh...

  • How to use Proxy Browser Extention with Proxy Manager

    There are two options to connect Bright Data Proxy Manager with the Proxy Browser extension: By using the Proxy Manager users created in the Control Panel By using Whitelisted IPs settings Proxy Browser Extension usage with the P...

  • Edge Browser Integration with Bright Data

    Click the Edge menu on the browser toolbar Select "Settings" Select “System and performance” at the left menu In the "System" section, click "Open your computer's proxy settings" Turn on the "Use a proxy server" box under "Manual ...

  • How do I integrate Bright Data as my proxy network?

    The recommended way to integrate Bright Data is through the open source Proxy Manager. Alternatively, you can find the Bright Data API here.For Firefox, chrome, or any other browser, use the Browsers API integration tool

  • How do I integrate Bright Data into a web browser automation tool?

    Integrating Bright Data into a web browser automation tool such as Selenium or Puppeteer can be done by route to Bright Data super proxy port which isbrd.superproxy.io:22225 and authenticate with your Bright Data Zone credentials.T...

  • Which ports and protocols are supported by Bright Data?

    Ports 80 and 443 are available by default, supporting HTTP and HTTPS protocols.The below table shows supported protocols by port: Port Protocol 80 HTTP and HTTP CONNECT 443 HTTPS   Bright Data can support additional ports...

See all 12 articles

General Tips

  • Request Timeout

    Slower connections may get a timeout from the super-proxy server (in the header) or from the target website (in the https). To avoid timeouts, set a longer timeout period (in the request). When you do that, you may want to increase...

  • General Tips to Avoid Blocking

    IPs The main things to consider for IPs are: Geolocation: it's generally best to match the peer country to the country of the target.Using more specific targeting can also help:City is more specific than State, and State more spec...

  • Add headers and cookies to your http/https requests

    Sometimes target sites can detect users as a bot or a crawler. In this case include headers and cookies in your http/https requests in order to mimic human behavior.

  • Mimic a human user

    Including all headers and cookie behavior. See bash example, using Bright Data Proxy Manager: curl --proxy http://127.0.0.1:PORT_NUM "http://lumtest.com/myip.json" -H 'pragma: no-cache' -H 'accept-encoding: gzip, deflate, br' -H 'a...

  • Rotate between as many unblocked IPs as possible

    Switch an IP when it gets an error, and use it again only after it cools down several hours. For optimal results use Bright Data Dedicated residential IPs. To do this you have 2 options: Use our API to control the IP rotation: Ch...

  • Remote DNS

    Using Remote DNS gives you a DNS resolve server similar to that of the Proxy peer (the origin of the Proxy's IP). This makes your request look more credible as the resolve server is usually located geographically close to the IP, w...

Performance

3rd Party Integrations

  • MultiloginX integration tutorial

      What is MultiloginX? MultiloginX allows for the creation of virtual browsing profiles, so you can manage multiple online accounts using physical device simulations. Some of the use cases of Multilogin include ads, affiliates, ti...

  • Proxifier Integration Guide

    Learn how to set up your Proxifier proxy settings and integrate them with Bright Data's Proxy IPs Proxifier is an advanced proxy client that allows network applications that do not support working through proxy servers to ope...

  • Selenium Proxy Integration with Bright Data

    Note: When using the Selenium Integration with the Bright DataSuper Proxy - you will have to handle the authentication by yourself.In order to avoid it - you can use the proxy manager tool. Learn how to set up your Selenium proxy...

  • VMLogin Proxy Integration with Bright Data

    VMLogin Proxy Integration with Bright Data Register and manage multiple online accounts using physical devices with VMLogin's virtual browsing profiles which helps enable anti-association capabilities as well as fingerprint pr...

  • PhantomBuster Proxy Integration with Bright Data

    PhantomBuster Proxy Integration with Bright Data Learn how to setup your PhantomBuster proxy settings and integrate with Bright Data's Proxy IPs PhantomBuster is a code-free automations and data extraction software that let...

Become a Bright Data professional

  • How to crawl a website without getting blocked or misled (cloaked)?

    Why should I care?When a target website detects crawlers from a proxy (datacenter) IP, it typically Blocks the IP, or Presents the IP with purposely misleading information, or Throttle down the response rate How does the target w...

  • How to get an IP in a specific city

    Why should I care?Example: If you are responsible for testing Yelp's city level service - you need to check the site from 10,000 different cities around the world.How to get an IP in a specific city?If you only use a traditional da...

  • How to accelerate your web scraping

    Why should I care?If the number of requests you rotate through a single IP are higher than what target websites allow, the website you target will identify your IP and block or mislead you with false information. It means that your...

  • How to rotate your IP address

    Why should I care?When many requests are sent to a website from the same IP, the website can tag the IP used as a crawler and send misleading information or block you. Periodically changing, or rotating, your IP address helps preve...

  • How do I avoid subnet block range?

    What is a subnet block range?Smaller sections of a network are called subnets, which are useful for grouping hosts together and managing them all at once. Subnets are based on IP address, making it easy for websites or malicious us...

  • How to switch from API to Proxy Manager

    Why should I care?Using the Proxy Manager offers advanced features that are not readily available in the API. Instead of having to manually code mechanisms for tasks like keeping an IP as long as possible or rotating your IP after ...

See all 8 articles

Troubleshooting

  • How to resolve "Auth Failed (code: ip_forbidden)"

    The Auth failed (also appears as 407 status code) within the "ip_forbidden" text message can happen when your proxy zone is configured with Whitelist IPs permission, and the machine IP (crawler) is not part of that list.In order to...

  • Why Am I getting '400 Proxy Error: ip_requested_not_allocated_by_customer' ?

    When Using the Data center/ISP or Gips products, the error code 400 can appear in case the IPs under your zone has been refreshed, removed, or simply changed due to system updatesWhenever this error appear, you should go to your Br...

  • What is "x-luminati-ip: superproxy bypass"

    Whenever targeting a domain that is not allowed or not in use with the right product, the Bright data "Network policy" monitoring system will either block the request or route it from the super proxy server. When routing from the s...

  • I need help with solving a technical issue

    In case you have an issue that you attempted and failed to resolve, and it has been made clear by a Bright Data representative that the problem does not originate in Bright Data, you may ask your account manager for a Developer Rev...

  • Getting blocked and not sure why?

    In order to understand if the block is generated by the target website or by your code, you should run the following command in the terminal/CMD/git bash etc. curl --proxy brd.superproxy.io:22225 --proxy-user USERNAME:PASSWORD -k "...

  • How do I handle a 407 error message (Proxy authentication required)?

    Encountering a 407 error message means that the client must first authenticate itself with the proxy. Resolving this issue requires adding the requested IPs, which are now refused connection, to the whitelist. For details, see Conf...

See all 11 articles