An inference request: the control port's infer words and GET /infer's query, parsed; results as text
$ sexc add @ajax/mesh-infer-request- total 3
- drwxr-xr-x-../
- drwxr-xr-x-Oct 27 05:23v/# 1 version
- drwxr-xr-x-Oct 27 05:23files/# the files of 0.1.0
- latest
- 0.1.0, published Oct 27 05:23 by ajax
- owners
- ajax
- license
- MIT
- dependencies
- @ajax/mesh-buf ^0.1.0, @ajax/mesh-rsfmt ^0.1.0, @ajax/mesh-infer-wire ^0.1.0, @ajax/mesh-check ^0.1.0
- dependents
- @ajax/mesh-control, @ajax/mesh-http-relay, @ajax/mesh-inferd
- keywords
- mesh alphaos inference gpt2 request
- homepage
- https://github.com/thomasdavis/alpha-c-mesh/tree/main/packages/mesh-infer-request
- repository
- https://github.com/thomasdavis/alpha-c-mesh
1# @ajax/mesh-infer-request 2 3An inference request: the control port's infer words and GET /infer's query, parsed; results as text. 4 5An `infer` request (infer.rs Request, parse, from_query, text): `infer [fast|fast16|exact|exact-cpu] [max N] [prefill=K decode=J | mono=K] [repeat=R] [len=N] <prompt>` on the control port, `GET /infer?prompt=..&max=..&mode=..` on meshd's http. 6 7```c 8#include "mesh/infer_request.h" 9``` 10 11## Ported from 12 13[alpha-rust-mesh](https://github.com/rsafier/alpha-rust-mesh) (Richard Safier, MIT): crates/mesh-host/src/infer.rs: `Request`, `USAGE`, `parse`, `text`, `from_query`, `url_decode`. 14 15## Tests 16 17- `tests/request.c`: infer.rs's `requests_parse`, and the error texts. 18 19## Licence 20 21MIT. See the repository's LICENSE.