skip to content
[readonly]

Where each member's inference services listen, and the address one member dials for another's

sh
$ sexc add @ajax/mesh-infer-svc
  • total 3
  • drwxr-xr-x-../
  • drwxr-xr-x-Oct 27 05:23v/# 1 version
  • drwxr-xr-x-Oct 27 05:23files/# the files of 0.1.0
latest
0.1.0, published Oct 27 05:23 by ajax
owners
ajax
license
MIT
dependencies
@ajax/mesh-buf ^0.1.0, @ajax/mesh-rsfmt ^0.1.0, @ajax/mesh-check ^0.1.0
dependents
@ajax/mesh-inferd, @ajax/mesh-shared, @ajax/meshd
keywords
mesh alphaos inference gpt2 addresses cluster
homepage
https://github.com/thomasdavis/alpha-c-mesh/tree/main/packages/mesh-infer-svc
repository
https://github.com/thomasdavis/alpha-c-mesh
==> README.md <==
1# @ajax/mesh-infer-svc
2
3Where each member's inference services listen, and the address one member dials for another's.
4
5Where each member's inference services listen (infer.rs Svc): its peer host and port (the base: a worker listens on base + its manifest's `param`) and the address members outside its subnet use (`k.lan` in the cluster config).
6
7```c
8#include "mesh/infer_svc.h"
9```
10
11## Ported from
12
13[alpha-rust-mesh](https://github.com/rsafier/alpha-rust-mesh) (Richard Safier, MIT): crates/mesh-host/src/infer.rs: `Svc` (single, cluster, addr), `split_hp`, `subnet24`.
14
15## Tests
16
17- `tests/svc.c`: infer.rs's `addresses_pick_the_shared_link`, and the error texts.
18
19## Differences
20
21- `cluster` reads the config through a lookup function instead of a `BTreeMap`.
22
23## Licence
24
25MIT. See the repository's LICENSE.