Streams service is a generic interface to support streaming of data between host and remote agents.
The service supports:
Command and event parameters are encoded as zero terminated JSON strings.
The service uses standard format for error reports, see Error Report Format.
C • <token> • Streams • subscribe • <string: stream source type> •
Clients must subscribe for one or more stream source types to be able to send or receive stream data. Stream source type name are defined by other services that use streams to transfer data. For example, Processes Service defines "Processes" strem source that represents standard input/output streams. Subscribers receive notifications when a stream of given type is created or disposed. Subscribers are required to respond with 'read' or 'disconnect' commands as necessary.
Reply:
R • <token> • <error report> •
If no error is reported, the client becomes a subscriber of streams of the given type - until channel is closed or the subscribtion is canceled by unsubscribe command. When new stream is created, each subscriber must decide if it is interested in that particular stream instance. If not interested, subscriber should send 'disconnect' command to allow remote peer to free resources and bandwidth allocated for the stream. If not disconnected, subscriber is required to send 'read' commands as necessary to pump stream data and prevent stream buffer overflow.
C • <token> • Streams • unsubscribe • <string: stream source type> •
Unsubscribe the client from given stream source type.
Reply:
R • <token> • <error report> •
C • <token> • Streams • read • <string: stream ID> • <int: size> •
stream ID size The command reads data from a stream. If stream buffer is empty, the command will wait until data is available. Remote peer will continue to process other commands while 'read' command is pending. Client can send more 'read' commands without waiting for the first command to complete. Doing that improves communication channel bandwidth utilization. Pending 'read' commands will be executed in same order as issued. Client can delay sending of 'read' command if it is not ready to receive more data, however, delaying for too long can cause stream buffer overflow and lost of data. .
Reply:
R • <token> • <string: data> • <error report> • <int: lost size> • <boolean: EOS> •
data lost size EOS C • <token> • Streams • write • <string: stream ID> • <int: size> • <string: data> •
stream ID size data must match the size.
data The command writes data to a stream. If stream buffer is full, the command will wait until space is available. Remote peer will continue to process other commands while 'write' command is pending. Client can send more 'write' commands without waiting for the first command to complete. Doing that improves communication channel bandwidth utilization. Pending 'write' commands will be executed in same order as issued.
Reply:
R • <token> • <error report> •
C • <token> • Streams • eos • <string: stream ID> •
The command sends End Of Stream marker to a stream. No more writing to the stream is allowed after that.
Reply:
R • <token> • <error report> •
C • <token> • Streams • disconnect • <string: stream ID> •
The command disconnects client from a stream. Note that disconnect does not destroy the stream, client on other channels can continue reading or writing the stream.
Reply:
R • <token> • <error report> •
Streams service sends events when a stream is created or disposed. Only clients with active subscribtion will recceive the events. Clients can change their subscription with subscribe and unsubscribe commands.
E • Streams • created • <string: stream type> • <string: stream ID> • E • Streams • disposed • <string: stream type> • <string: stream ID> •
public interface IStreams extends IService {
/**
* Service name.
*/
static final String NAME = "Streams";
/**
* Clients can implement StreamsListener interface to be notified
* when a stream is created or disposed. The interface is registered with 'subscribe' command.
*
* When new stream is created, client must decide if it is interested in that particular stream instance.
* If not interested, client should send 'disconnect' command to allow remote peer to free resources and bandwidth.
* If not disconnected, client is required to send 'read' commands as necessary to prevent stream buffer overflow.
*/
interface StreamsListener {
/**
* Called when a new stream is created.
* @param stream_type - source type of the stream.
* @param stream_id - ID of the stream.
*/
void created(String stream_type, String stream_id);
/**
* Called when a stream is disposed.
* @param stream_type - source type of the stream.
* @param stream_id - ID of the stream.
*/
void disposed(String stream_type, String stream_id);
}
/**
* Clients must subscribe for one or more stream types to be able to send or receive stream data.
* Subscribers receive notifications when a stream of given type is created or disposed.
* Subscribers are required to respond with 'read' or 'disconnect' commands as necessary.
* @param stream_type - the stream source type.
* @param listener - client implementation of StreamsListener interface.
* @param done - command result call back object.
* @return - pending command handle.
*/
IToken subscribe(String stream_type, StreamsListener listener, DoneSubscribe done);
/**
* Call back interface for 'subscribe' command.
*/
interface DoneSubscribe {
void doneSubscribe(IToken token, Exception error);
}
/**
* Unsubscribe the client from given stream source type.
* @param stream_type - the stream source type.
* @param listener - client implementation of StreamsListener interface.
* @param done - command result call back object.
* @return - pending command handle.
*/
IToken unsubscribe(String stream_type, StreamsListener listener, DoneUnsubscribe done);
/**
* Call back interface for 'unsubscribe' command.
*/
interface DoneUnsubscribe {
void doneUnsubscribe(IToken token, Exception error);
}
/**
* Read data from a stream. If stream buffer is empty, the command will wait until data is available.
* Remote peer will continue to process other commands while 'read' command is pending.
* Client can send more 'read' commands without waiting for the first command to complete.
* Doing that improves communication channel bandwidth utilization.
* Pending 'read' commands will be executed in same order as issued.
* Client can delay sending of 'read' command if it is not ready to receive more data,
* however, delaying for too long can cause stream buffer overflow and lost of data.
* @param stream_id - ID of the stream.
* @param size - max number of bytes to read.
* @param done - command result call back object.
* @return - pending command handle.
*/
IToken read(String stream_id, int size, DoneRead done);
/**
* Call back interface for 'read' command.
*/
interface DoneRead {
/**
* Called when 'read' command is done.
* @param token - command handle.
* @param error - error object or null.
* @param lost_size - number of bytes that were lost because of buffer overflow.
* 'lost_size' -1 means unknown number of bytes were lost.
* if both 'lost_size' and 'data.length' are non-zero then lost bytes are considered
* located right before read bytes.
* @param data - bytes read from the stream.
* @param eos - true if end of stream was reached.
*/
void doneRead(IToken token, Exception error, int lost_size, byte[] data, boolean eos);
}
/**
* Write data to a stream. If stream buffer is full, the command will wait until space is available.
* Remote peer will continue to process other commands while 'write' command is pending.
* Client can send more 'write' commands without waiting for the first command to complete.
* Doing that improves communication channel bandwidth utilization.
* Pending 'write' commands will be executed in same order as issued.
* @param stream_id - ID of the stream.
* @param buf - buffer that contains stream data.
* @param offset - byte offset in the buffer.
* @param size - number of bytes to write.
* @param done - command result call back object.
* @return - pending command handle.
*/
IToken write(String stream_id, byte[] buf, int offset, int size, DoneWrite done);
/**
* Call back interface for 'write' command.
*/
interface DoneWrite {
/**
* Called when 'write' command is done.
* @param token - command handle.
* @param error - error object or null.
*/
void doneWrite(IToken token, Exception error);
}
/**
* Send End Of Stream marker to a stream. No more writing to the stream is allowed after that.
* @param stream_id - ID of the stream.
* @param done - command result call back object.
* @return - pending command handle.
*/
IToken eos(String stream_id, DoneEOS done);
/**
* Call back interface for 'eos' command.
*/
interface DoneEOS {
/**
* Called when 'eos' command is done.
* @param token - command handle.
* @param error - error object or null.
*/
void doneEOS(IToken token, Exception error);
}
/**
* Disconnect client from a stream.
* @param stream_id - ID of the stream.
* @param done - command result call back object.
* @return - pending command handle.
*/
IToken disconnect(String stream_id, DoneDisconnect done);
/**
* Call back interface for 'disconnect' command.
*/
interface DoneDisconnect {
/**
* Called when 'disconnect' command is done.
* @param token - command handle.
* @param error - error object or null.
*/
void doneDisconnect(IToken token, Exception error);
}
}