bittensor.dendrite
#
Module Contents#
Classes#
The Dendrite class, inheriting from PyTorch's Module class, represents the abstracted |
- class bittensor.dendrite.dendrite(wallet=None)#
Bases:
torch.nn.Module
The Dendrite class, inheriting from PyTorch’s Module class, represents the abstracted implementation of a network client module. In the brain analogy, dendrites receive signals from other neurons (in this case, network servers or axons), and the Dendrite class here is designed to send requests to those endpoint to recieve inputs.
This class includes a wallet or keypair used for signing messages, and methods for making HTTP requests to the network servers. It also provides functionalities such as logging network requests and processing server responses.
- Parameters:
wallet (Optional[Union[bittensor.wallet, bittensor.keypair]]) –
- keypair#
The wallet or keypair used for signing messages.
- __repr__()#
Returns a string representation of the Dendrite object, acting as a fallback for __str__().
- Return type:
- query(self, *args, **kwargs) bittensor.Synapse | List[bittensor.Synapse] #
Makes synchronous requests to one or multiple target Axons and returns responses.
- Return type:
Union[bittensor.Synapse, List[bittensor.Synapse], bittensor.StreamingSynapse, List[bittensor.StreamingSynapse]]
- forward(self, axons, synapse=bittensor.Synapse(), timeout=12, deserialize=True, run_async=True, streaming=False) bittensor.Synapse #
Asynchronously sends requests to one or multiple Axons and collates their responses.
- Parameters:
axons (Union[List[Union[bittensor.AxonInfo, bittensor.axon]], Union[bittensor.AxonInfo, bittensor.axon]]) –
synapse (bittensor.Synapse) –
timeout (float) –
deserialize (bool) –
run_async (bool) –
streaming (bool) –
- Return type:
List[Union[AsyncGenerator[Any], bittenst.Synapse, bittensor.StreamingSynapse]]
- call(self, target_axon, synapse=bittensor.Synapse(), timeout=12.0, deserialize=True) bittensor.Synapse #
Asynchronously sends a request to a specified Axon and processes the response.
- Parameters:
target_axon (Union[bittensor.AxonInfo, bittensor.axon]) –
synapse (bittensor.Synapse) –
timeout (float) –
deserialize (bool) –
- Return type:
- call_stream(self, target_axon, synapse=bittensor.Synapse(), timeout=12.0, deserialize=True) AsyncGenerator[bittensor.Synapse, None] #
Sends a request to a specified Axon and yields an AsyncGenerator that contains streaming response chunks before finally yielding the filled Synapse as the final element.
- Parameters:
target_axon (Union[bittensor.AxonInfo, bittensor.axon]) –
synapse (bittensor.Synapse) –
timeout (float) –
deserialize (bool) –
- Return type:
AsyncGenerator[Any]
- preprocess_synapse_for_request(self, target_axon_info, synapse, timeout=12.0) bittensor.Synapse #
Preprocesses the synapse for making a request, including building headers and signing.
- Parameters:
target_axon_info (bittensor.AxonInfo) –
synapse (bittensor.Synapse) –
timeout (float) –
- Return type:
- process_server_response(self, server_response, json_response, local_synapse)#
Processes the server response, updates the local synapse state, and merges headers.
- Parameters:
server_response (fastapi.Response) –
json_response (dict) –
local_synapse (bittensor.Synapse) –
- close_session(self)#
Synchronously closes the internal aiohttp client session.
- aclose_session(self)#
Asynchronously closes the internal aiohttp client session.
NOTE: When working with async aiohttp client sessions, it is recommended to use a context manager.
- Example with a context manager:
>>> aysnc with dendrite(wallet = bittensor.wallet()) as d: >>> print(d) >>> d( <axon> ) # ping axon >>> d( [<axons>] ) # ping multiple >>> d( bittensor.axon(), bittensor.Synapse )
However, you are able to safely call dendrite.query() without a context manager in a synchronous setting.
- Example without a context manager:
>>> d = dendrite(wallet = bittensor.wallet() ) >>> print(d) >>> d( <axon> ) # ping axon >>> d( [<axons>] ) # ping multiple >>> d( bittensor.axon(), bittensor.Synapse )
- property session: aiohttp.ClientSession#
An asynchronous property that provides access to the internal aiohttp client session.
This property ensures the management of HTTP connections in an efficient way. It lazily initializes the aiohttp.ClientSession on its first use. The session is then reused for subsequent HTTP requests, offering performance benefits by reusing underlying connections.
This is used internally by the dendrite when querying axons, and should not be used directly unless absolutely necessary for your application.
- Returns:
The active aiohttp client session instance. If no session exists, a new one is created and returned. This session is used for asynchronous HTTP requests within the dendrite, adhering to the async nature of the network interactions in the Bittensor framework.
- Return type:
aiohttp.ClientSession
- Example usage:
import bittensor as bt # Import bittensor wallet = bt.wallet( … ) # Initialize a wallet dendrite = bt.dendrite( wallet ) # Initialize a dendrite instance with the wallet
- async with (await dendrite.session).post( # Use the session to make an HTTP POST request
url, # URL to send the request to headers={…}, # Headers dict to be sent with the request json={…}, # JSON body data to be sent with the request timeout=10, # Timeout duration in seconds
- ) as response:
json_response = await response.json() # Extract the JSON response from the server
- close_session()#
Closes the internal aiohttp client session synchronously.
This method ensures the proper closure and cleanup of the aiohttp client session, releasing any resources like open connections and internal buffers. It is crucial for preventing resource leakage and should be called when the dendrite instance is no longer in use, especially in synchronous contexts.
Note: This method utilizes asyncio’s event loop to close the session asynchronously from a synchronous context. It is advisable to use this method only when asynchronous context management is not feasible.
- Usage:
# When finished with dendrite in a synchronous context dendrite_instance.close_session()
- async aclose_session()#
Asynchronously closes the internal aiohttp client session.
This method is the asynchronous counterpart to the close_session method. It should be used in asynchronous contexts to ensure that the aiohttp client session is closed properly. The method releases resources associated with the session, such as open connections and internal buffers, which is essential for resource management in asynchronous applications.
- Usage:
# When finished with dendrite in an asynchronous context await dendrite_instance.aclose_session()
Example
- async with dendrite_instance:
# Operations using dendrite pass
# The session will be closed automatically after the above block
- _get_endpoint_url(target_axon, request_name)#
Constructs the endpoint URL for a network request to a target axon.
This internal method generates the full HTTP URL for sending a request to the specified axon. The URL includes the IP address and port of the target axon, along with the specific request name. It differentiates between requests to the local system (using ‘0.0.0.0’) and external systems.
- Parameters:
target_axon – The target axon object containing IP and port information.
request_name – The specific name of the request being made.
- Returns:
A string representing the complete HTTP URL for the request.
- Return type:
- _handle_request_errors(synapse, request_name, exception)#
Handles exceptions that occur during network requests, updating the synapse with appropriate status codes and messages.
This method interprets different types of exceptions and sets the corresponding status code and message in the synapse object. It covers common network errors such as connection issues and timeouts.
- Parameters:
synapse – The synapse object associated with the request.
request_name – The name of the request during which the exception occurred.
exception – The exception object caught during the request.
Note: This method updates the synapse object in-place.
- _log_outgoing_request(synapse)#
Logs information about outgoing requests for debugging purposes.
This internal method logs key details about each outgoing request, including the size of the request, the name of the synapse, the axon’s details, and a success indicator. This information is crucial for monitoring and debugging network activity within the Bittensor network.
To turn on debug messages, set the environment variable BITTENSOR_DEBUG to 1. or call the bittensor debug method like so:
`python import bittensor bittensor.debug() `
- Parameters:
synapse – The synapse object representing the request being sent.
- _log_incoming_response(synapse)#
Logs information about incoming responses for debugging and monitoring.
Similar to _log_outgoing_request, this method logs essential details of the incoming responses, including the size of the response, synapse name, axon details, status code, and status message. This logging is vital for troubleshooting and understanding the network interactions in Bittensor.
- Parameters:
synapse – The synapse object representing the received response.
- query(*args, **kwargs)#
Makes a synchronous request to multiple target Axons and returns the server responses.
Cleanup is automatically handled and sessions are closed upon completed requests.
- Parameters:
axons (Union[List[Union['bittensor.AxonInfo', 'bittensor.axon']], Union['bittensor.AxonInfo', 'bittensor.axon']]) – The list of target Axon information.
synapse (bittensor.Synapse, optional) – The Synapse object. Defaults to bittensor.Synapse().
timeout (float, optional) – The request timeout duration in seconds. Defaults to 12.0 seconds.
- Returns:
- If a single target axon is provided,
returns the response from that axon. If multiple target axons are provided, returns a list of responses from all target axons.
- Return type:
Union[bittensor.Synapse, List[bittensor.Synapse]]
- async forward(axons, synapse=bittensor.Synapse(), timeout=12, deserialize=True, run_async=True, streaming=False)#
Asynchronously sends requests to one or multiple Axons and collates their responses.
This function acts as a bridge for sending multiple requests concurrently or sequentially based on the provided parameters. It checks the type of the target Axons, preprocesses the requests, and then sends them off. After getting the responses, it processes and collates them into a unified format.
When querying an Axon that sends a single response, this function returns a Synapse object containing the response data. If multiple Axons are queried, a list of Synapse objects is returned, each containing the response from the corresponding Axon.
- For example:
>>> ... >>> wallet = bittensor.wallet() # Initialize a wallet >>> synapse = bittensor.Synapse(...) # Create a synapse object that contains query data >>> dendrte = bittensor.dendrite(wallet = wallet) # Initialize a dendrite instance >>> axons = metagraph.axons # Create a list of axons to query >>> responses = await dendrite(axons, synapse) # Send the query to all axons and await the responses
When querying an Axon that sends back data in chunks using the Dendrite, this function returns an AsyncGenerator that yields each chunk as it is received. The generator can be iterated over to process each chunk individually.
- For example:
>>> ... >>> dendrte = bittensor.dendrite(wallet = wallet) >>> async for chunk in dendrite.forward(axons, synapse, timeout, deserialize, run_async, streaming): >>> # Process each chunk here >>> print(chunk)
- Parameters:
axons (Union[List[Union['bittensor.AxonInfo', 'bittensor.axon']], Union['bittensor.AxonInfo', 'bittensor.axon']]) – The target Axons to send requests to. Can be a single Axon or a list of Axons.
synapse (bittensor.Synapse, optional) – The Synapse object encapsulating the data. Defaults to a new bittensor.Synapse instance.
timeout (float, optional) – Maximum duration to wait for a response from an Axon in seconds. Defaults to 12.0.
deserialize (bool, optional) – Determines if the received response should be deserialized. Defaults to True.
run_async (bool, optional) – If True, sends requests concurrently. Otherwise, sends requests sequentially. Defaults to True.
streaming (bool, optional) – Indicates if the response is expected to be in streaming format. Defaults to False.
- Returns:
If a single Axon is targeted, returns its response. If multiple Axons are targeted, returns a list of their responses.
- Return type:
Union[AsyncGenerator, bittensor.Synapse, List[bittensor.Synapse]]
- async call(target_axon, synapse=bittensor.Synapse(), timeout=12.0, deserialize=True)#
Asynchronously sends a request to a specified Axon and processes the response.
This function establishes a connection with a specified Axon, sends the encapsulated data through the Synapse object, waits for a response, processes it, and then returns the updated Synapse object.
- Parameters:
target_axon (Union['bittensor.AxonInfo', 'bittensor.axon']) – The target Axon to send the request to.
synapse (bittensor.Synapse, optional) – The Synapse object encapsulating the data. Defaults to a new bittensor.Synapse instance.
timeout (float, optional) – Maximum duration to wait for a response from the Axon in seconds. Defaults to 12.0.
deserialize (bool, optional) – Determines if the received response should be deserialized. Defaults to True.
- Returns:
The Synapse object, updated with the response data from the Axon.
- Return type:
- async call_stream(target_axon, synapse=bittensor.Synapse(), timeout=12.0, deserialize=True)#
Sends a request to a specified Axon and yields streaming responses.
Similar to call, but designed for scenarios where the Axon sends back data in multiple chunks or streams. The function yields each chunk as it is received. This is useful for processing large responses piece by piece without waiting for the entire data to be transmitted.
- Parameters:
target_axon (Union['bittensor.AxonInfo', 'bittensor.axon']) – The target Axon to send the request to.
synapse (bittensor.Synapse, optional) – The Synapse object encapsulating the data. Defaults to a new bittensor.Synapse instance.
timeout (float, optional) – Maximum duration to wait for a response (or a chunk of the response) from the Axon in seconds. Defaults to 12.0.
deserialize (bool, optional) – Determines if each received chunk should be deserialized. Defaults to True.
- Yields:
object – Each yielded object contains a chunk of the arbitrary response data from the Axon. bittensor.Synapse: After the AsyncGenerator has been exhausted, yields the final filled Synapse.
- Return type:
AsyncGenerator[Any]
- preprocess_synapse_for_request(target_axon_info, synapse, timeout=12.0)#
Preprocesses the synapse for making a request. This includes building headers for Dendrite and Axon and signing the request.
- Parameters:
target_axon_info (bittensor.AxonInfo) – The target axon information.
synapse (bittensor.Synapse) – The synapse object to be preprocessed.
timeout (float, optional) – The request timeout duration in seconds. Defaults to 12.0 seconds.
- Returns:
The preprocessed synapse.
- Return type:
- process_server_response(server_response, json_response, local_synapse)#
Processes the server response, updates the local synapse state with the server’s state and merges headers set by the server.
- Parameters:
server_response (object) – The aiohttp response object from the server.
json_response (dict) – The parsed JSON response from the server.
local_synapse (bittensor.Synapse) – The local synapse object to be updated.
- Raises:
None, but errors in attribute setting are silently ignored. –
- __str__()#
Returns a string representation of the Dendrite object.
- Returns:
The string representation of the Dendrite object in the format “dendrite(<user_wallet_address>)”.
- Return type:
- __repr__()#
Returns a string representation of the Dendrite object, acting as a fallback for __str__().
- Returns:
The string representation of the Dendrite object in the format “dendrite(<user_wallet_address>)”.
- Return type:
- async __aenter__()#
Asynchronous context manager entry method.
Enables the use of the async with statement with the Dendrite instance. When entering the context, the current instance of the class is returned, making it accessible within the asynchronous context.
- Returns:
The current instance of the Dendrite class.
- Return type:
Dendrite
- Usage:
- async with Dendrite() as dendrite:
await dendrite.some_async_method()
- async __aexit__(exc_type, exc_value, traceback)#
Asynchronous context manager exit method.
Ensures proper cleanup when exiting the async with context. This method will close the aiohttp client session asynchronously, releasing any tied resources.
- Parameters:
exc_type (Type[BaseException], optional) – The type of exception that was raised.
exc_value (BaseException, optional) – The instance of exception that was raised.
traceback (TracebackType, optional) – A traceback object encapsulating the call stack at the point where the exception was raised.
- Usage:
- async with bt.dendrite( wallet ) as dendrite:
await dendrite.some_async_method()
Note: This automatically closes the session by calling __aexit__ after the context closes.
- __del__()#
Dendrite destructor.
This method is invoked when the Dendrite instance is about to be destroyed. The destructor ensures that the aiohttp client session is closed before the instance is fully destroyed, releasing any remaining resources.
Note: Relying on the destructor for cleanup can be unpredictable. It’s recommended to explicitly close sessions using the provided methods or the async with context manager.
- Usage:
dendrite = Dendrite() # … some operations … del dendrite # This will implicitly invoke the __del__ method and close the session.