dendrite-python-sdk

The dendrite-python-sdk provides powerful tools for building web AI agents capable of authenticating, interacting with, and extracting data from any website. This SDK is ideal for developers looking to automate web tasks and enhance their AI applications.

[{"step":"Install and configure the dendrite-python-sdk","action":"Run `pip install dendrite-python-sdk` and set up your API credentials in the SDK configuration file. Ensure you have your developer access token from [ChatBot settings](https://app.chatbot.com/settings/developers).","tip":"Use environment variables for sensitive tokens: `export DENDRITE_ACCESS_TOKEN='your_token_here'`"},{"step":"Define the target website and authentication method","action":"Specify the target URL in your script and configure authentication. For example, use session cookies for logged-in pages or OAuth for API-based sites.","tip":"Test authentication separately first. Use browser dev tools to capture required headers or cookies."},{"step":"Design the data extraction workflow","action":"Use the SDK's `Agent` class to create a web agent. Define navigation steps (e.g., go to product page, scroll to load dynamic content) and specify data fields to extract using CSS selectors or XPath.","tip":"Start with a single product page to validate selectors before scaling to multiple pages."},{"step":"Handle edge cases and dynamic content","action":"Implement retry logic for failed requests, add delays for dynamic content loading, and use the SDK's built-in CAPTCHA solvers or proxy rotation if needed.","tip":"Log all errors and retries to debug issues. Use `logging` module to track agent behavior."},{"step":"Export and validate the extracted data","action":"Save the structured data to a JSON file or database. Validate the output against a sample of the website to ensure accuracy.","tip":"Compare extracted data with manual checks for critical fields like prices or availability."}]