All the Inference by penderis

View this thread on: hive.blog | peakd.com | ecency.com

ai · @penderis · Feb 18 '24

$4.79

All the Inference

It is a stupid word really, "Inference" , it the word used to mean using an AI in production. Why they don't just say that I don't know.

Anyway to actually run many of the models available will almost always cost you something, be it time or money, and with both there is free pain.

Searching a bit I really could not find any free API services for these models, and I guess it is fair enough since they are not exactly light on hardware.

My main query was basically how to approach automation using AI, because then I can spam email people for money or to put me in their inheritance. This does not seem as simple as signing up and using any one thing though.

Well, not so simple if you are a cheapskate, hence the emails.

It seems what all the AI sites tend to not mention in plain language is that they are just "Managers" , all of them just orchestrate responses from ChatGPT for the most part then pipe that to this or that application.

Sure that is nice so there are many interfaces to manipulate and use responses from an AI but it still does not give you access to an AI that won't cost you a dollar every time you want to know the weather.

In that vein there are far more Agent style interfaces and projects than there are actual ones where you can just run an AI model yourself to play with.

The only two I found that are pretty the standard is <a href="https://lmstudio.ai/">LM Studio</a> and <a href="https://h2o.ai/platform/open-source-gpt-and-llm-studio/">h2O Studio</a>

![](https://images.ecency.com/DQmYsy527LbFDgHpaAmR1U1bpCpDVWtWu8VUcT5dg6MrA7b/image.png)

Where <a href="https://lmstudio.ai/">LM Studio</a> would be the defacto purely based on resource usage.

I fortunately do have a solid laptop so in the next week I will play a bit with some local LLM models and get a feel for the agent orchestration possibly choosing between n8n, autogen, superagi or crew.ai ... It seems to me they do pretty much the same thing but n8n is a nice drag and drop solution like "if this then that".

As much as it would be nice to make a whole long simple to digest list of actual useful tools the ones with true flexibility need a bit of elbow grease. Which is why a local version or reliable free api to run the tools on becomes more important.

I guess for the most part hounding Google Collab for free resources is also a option albeit a hit and miss.

👍 trostparadox, pdq, c0ff33a, sbi5, dreemport, thealliance, kenechukwu97, mypathtofire, qubes, nainaztengra, antisocialist, enforcer48, chops316, blanchy, dreemsteem, acgalarza, insaneworks, fieryfootprints, mimismartypants, nickydee, brofi, omra-sky, thehive, huckleberrie, moeknows, xyba, samsmith1971, amberkashif, biggerjoe, cryptictruth, jayna, hijosdelhombre, fambalam, hive-data, wannabescrapper, bigtom13, skiptvads, grindan, princessmewmew, tamala, vm2904, nonsowrites, a11y, arc7icwolf, alliedforces, elizacheng, hucksbucks, khimgoh, steemseph, bitcoinman, kchitrah, salicj, lordnasty, esther-emmanuel, vikar, melbourneswest, whiterosecoffee, isnochys, davidbright, psyberx, communityunity, juliamulcahy, silverquest, themothership, and 107 others

`author`	penderis
`permlink`	all-the-inference
`category`	ai
`json_metadata`	"{"image":["https://images.ecency.com/DQmYsy527LbFDgHpaAmR1U1bpCpDVWtWu8VUcT5dg6MrA7b/image.png"],"tags":["ai","tools","discovery","local-ai","chatbot","proofofbrain","hive-engine"],"description":"It is a stupid word really, \"Inference\" , it the word used to mean using an AI in production. Why they don't just say that I don't know. Anyway to actually run many of the models available will","app":"ecency/3.0.37-vision","format":"markdown+html","image_ratios":["2.1918"]}"
`created`	2024-02-18 20:28:57
`last_update`	2024-02-18 20:28:57
`depth`	0
`children`	5
`last_payout`	2024-02-25 20:28:57
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	2.410 HBD
`curator_payout_value`	2.381 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	2,384
`author_reputation`	153,012,169,855,556
`root_title`	"All the Inference"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	131,401,431
`net_rshares`	10,640,754,408,525
`author_curate_reward`	""

properties (23)vote details (171)

voter	rshares	pct
adsactly	501,662,868	15%
dwinblood	3,589,305,708	40%
shadowspub	1,454,199,039	0.75%
ats-david	3,135,096,013	50%
dadview	4,074,439,980	7.5%
supergoodliving	586,421,645	50%
ahmadmanga	692,205,132	40%
dreemsteem	180,171,895,083	100%
qubes	303,145,871,646	50%
elizacheng	15,913,269,772	9%
dyrt88	3,560,090,968	100%
c0ff33a	345,189,907,018	10%
freebornsociety	2,876,968,633	5.55%
bitcoinman	14,576,509,106	15%
dabeckster	1,524,977,585	4.5%
gohba.handcrafts	593,931,346	7%
cryptoknight12	1,523,354,693	5.85%
deadgrlsuppastar	2,868,607,530	8%
vm2904	20,741,869,008	15%
mamadini	5,345,337,482	35%
jayna	32,283,267,891	4.5%
princessmewmew	22,753,191,964	7.5%
joeyarnoldvn	471,316,156	1.47%
hardikv	891,012,125	7.5%
edthecanadian	1,171,491,289	6.45%
nyinyiwin	6,168,292,835	50%
fiftysixnorth	1,628,139,975	4.5%
moeknows	44,443,562,709	35%
vikar	10,231,569,020	10%
nainaztengra	266,659,649,855	20%
chops316	201,609,946,553	100%
molovelly	614,593,393	7.5%
splash-of-angs63	1,590,655,502	7.5%
omra-sky	56,610,248,790	50%
thealliance	316,895,000,179	15%
isnochys	9,520,514,376	5%
steemseph	14,841,468,145	10%
simgirl	2,745,699,788	7.5%
bluefinstudios	1,717,825,651	0.75%
byn	1,283,828,182	6%
iamthegray	559,379,913	100%
syndicates	6,148,082,624	15%
a11y	17,440,633,026	15%
mcyusuf	1,964,288,286	100%
sneakyninja	1,875,906,906	2.92%
crescendoofpeace	2,917,744,995	3.75%
astrea	3,624,741,850	15%
themothership	7,113,069,077	7.5%
hijosdelhombre	30,621,836,642	25%
emjoe	1,042,787,978	7.5%
bengy	1,653,350,893	1.5%
cygon	629,832,735	7.5%
christianyocte	548,337,793	1.5%
fieryfootprints	98,156,980,167	40%
khimgoh	15,271,834,075	7.5%
mastergerund	2,103,892,867	5.85%
hazem91	987,714,339	4.5%
bigtom13	25,176,845,394	4.95%
felixgarciap	1,584,194,736	7.5%
tamala	22,490,231,760	100%
cryptictruth	35,008,209,394	7.5%
antisocialist	249,653,465,255	33%
melbourneswest	9,960,190,043	10%
casperleow	5,326,340,670	90%
philippekiene	1,699,368,887	7.5%
mumma-monza	824,218,743	7.5%
pretty.dorky	2,895,781,090	100%
veteranforcrypto	614,851,533	3%
enforcer48	240,397,984,929	20%
insaneworks	104,580,514,335	50%
topbooster	808,634,595	50%
sbi5	328,441,006,028	54.39%
kchitrah	14,368,570,626	100%
ambiguity	1,596,092,678	3.75%
thedailysneak	2,476,180,339	2.92%
alliedforces	16,792,630,063	15%
thehive	53,841,670,354	83%
welcomewagon	1,808,179,892	25%
mimismartypants	83,490,734,565	100%
voxmortis	2,783,385,244	1.5%
pdq	1,332,750,012,992	50%
ravensavage	493,368,364	5.85%
marshalmugi	3,226,248,076	100%
worksinsane	1,479,887,916	80%
blanchy	184,302,470,978	100%
hyperbole	4,819,552,847	100%
nonsowrites	18,671,651,829	25%
bro-poker	693,503,355	50%
lordfirewire	1,566,955,564	100%
incinboost	5,629,504,141	8.93%
smokingfit	899,322,825	100%
juliamulcahy	7,546,602,294	50%
slothlydoesit	2,157,929,404	1.87%
whiterosecoffee	9,781,988,596	5%
tinyhousecryptos	471,320,688	5%
fambalam	30,376,670,800	15%
dreemsavingsfund	572,262,209	75%
thealliancebank	1,857,682,976	15%
the.lazy.panda	555,578,231	10%
sbi-tokens	4,550,155,107	5.85%
acta	4,982,196,371	100%
the-table	6,899,272,889	83%
silverquest	7,177,198,505	100%
bozz.sports	4,307,503,335	4%
honeychip	6,890,461,149	90%
darthsauron	2,238,236,793	50%
rumors	2,996,196,766	40%
bilpcoinbpc	820,693,662	5%
tommys.shop	1,786,519,848	62.25%
brofund	542,731,559	0.62%
penned-bullshit	473,861,885	50%
hive-data	26,957,702,511	5%
communityunity	7,913,059,497	15%
infinikxs	884,476,413	100%
ismaelrd04	627,677,014	7.5%
dalz.shorts	772,420,054	50%
yayogerardo	552,033,562	33%
tergan604	6,008,490,654	15%
esther-emmanuel	12,142,791,219	100%
kenechukwu97	312,083,588,115	100%
cescajove	2,784,500,518	10%
trostparadox	3,973,212,506,820	100%
suara8	225,940,569	100%
bobthebuilder2	6,104,739,975	7.5%
xyba	44,234,021,590	100%
brofi	62,176,013,372	0.62%
amberkashif	42,178,214,104	40%
davidbright	9,084,663,021	30%
mmykel	748,762,941	25%
biggerjoe	36,257,597,331	15%
bbqgriffinwings	747,120,217	85%
dreemport	318,870,032,414	100%
samsmith1971	43,814,262,299	100%
moonshyne	1,137,346,490	75%
jaydr	1,142,801,468	7.5%
seattlea	1,043,385,489	3.75%
arc7icwolf	17,163,972,915	15%
deraaa	4,423,211,684	20%
tierra-errante	271,327,332	100%
psyberx	8,644,143,230	1%
khoola	2,348,744,475	50%
trostparadox.vyb	1,028,243,551	50%
vyb.pob	2,004,201,622	50%
thgaming	1,026,289,937	3.75%
huckleberrie	52,246,769,669	100%
vyb.curation	1,148,405,312	50%
hucksbucks	15,721,408,024	100%
haveyaheard	1,919,438,822	15%
mypathtofire	307,107,267,977	17.2%
pobscholarship	566,429,180	50%
toekins	512,141,267	15%
rocco-maloney	2,822,673,583	100%
acgalarza	148,440,726,900	40%
iwannabeme	1,345,186,067	7.5%
wannabescrapper	26,743,832,931	100%
assistance	957,868,903	15%
salicj	13,580,109,209	30%
nickydee	78,688,357,709	100%
grindan	23,596,707,217	10%
slothbuzz	2,610,070,130	7.5%
whitneyalexx	1,679,805,445	7.5%
slothburn	1,666,705,405	7.5%
skiptvads	24,567,218,233	10%
captain-carrot	1,791,726,499	100%
ma3str0	3,002,119,837	25%
lordnasty	13,120,944,175	100%
yummycruz1	868,672,393	50%
tslu	775,610,746	100%
tsjen	1,505,064,138	100%
monzo	4,729,102,093	100%
stewiekobe	3,431,332,352	100%

@mimismartypants · Feb 19 '24

$0.02

I really dont know what you talking about? Models with bums or code?

!PIZZA !LOLZ

👍 penderis, dustbunny

`author`	mimismartypants
`permlink`	re-penderis-2024219t113548617z
`category`	ai
`json_metadata`	{"tags":["ai","tools","discovery","local-ai","chatbot","proofofbrain","hive-engine"],"app":"ecency/3.0.37-vision","format":"markdown+html"}
`created`	2024-02-19 09:35:48
`last_update`	2024-02-19 09:35:48
`depth`	1
`children`	3
`last_payout`	2024-02-26 09:35:48
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.012 HBD
`curator_payout_value`	0.012 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	82
`author_reputation`	81,104,231,720,459
`root_title`	"All the Inference"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	131,414,489
`net_rshares`	58,512,871,510
`author_curate_reward`	""

properties (23)vote details (2)

voter	weight	wgt%	rshares	pct	time
penderis	0 B		36,829,306,089	100%
dustbunny	0 B		21,683,565,421	6.67%

@lolzbot · Feb 19 '24

<div class='pull-right'><center><img src="https://lolztoken.com/lolz.png"><br><a href="https://lolztoken.com">lolztoken.com</a></p><br><br><br><br></center></div><p><center><strong>Did you hear about the cowardly pigeon?<br>He lacked COO-rage.</strong><br><sub>Credit: <a href="https://peakd.com/@reddit">reddit</a></sub><br>@penderis, I sent you an <a href="https://lolztoken.com">$LOLZ</a> on behalf of mimismartypants<br><br>(2/4)<br><div class='pull-left'>https://files.peakd.com/file/peakd-hive/cryptoshots.nft/23xoaireZsyZCrvZLKneUuKiKWkGSajVRi9FspoMe3F5bpYmsQR8tyvNzoiQ3uJLLfqPy.png</div><br><h2><center><a href='https://play.crypto-shots.com'>PLAY</a> & EARN <a href='https://hive-engine.com/trade/DOOM'>$DOOM</a></center></h2></center></p>

properties (22)

`author`	lolzbot
`permlink`	re-re-penderis-2024219t113548617z-20240219t094007z
`category`	ai
`json_metadata`	"{"app": "beem/0.24.19"}"
`created`	2024-02-19 09:40:15
`last_update`	2024-02-19 09:40:15
`depth`	2
`children`	0
`last_payout`	2024-02-26 09:40:15
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	748
`author_reputation`	196,354,919,637,340
`root_title`	"All the Inference"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	131,414,552
`net_rshares`	0

@penderis · Feb 19 '24

$0.02

I know nothing of either so we both have no clue :P

👍 mimismartypants, dustbunny

`author`	penderis
`permlink`	re-mimismartypants-2024219t215515678z
`category`	ai
`json_metadata`	{"tags":["ai","tools","discovery","local-ai","chatbot","proofofbrain","hive-engine"],"app":"ecency/3.0.37-vision","format":"markdown+html"}
`created`	2024-02-19 19:55:15
`last_update`	2024-02-19 19:55:15
`depth`	2
`children`	1
`last_payout`	2024-02-26 19:55:15
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.012 HBD
`curator_payout_value`	0.012 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	52
`author_reputation`	153,012,169,855,556
`root_title`	"All the Inference"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	131,427,808
`net_rshares`	58,952,357,954
`author_curate_reward`	""

properties (23)vote details (2)

voter	weight	wgt%	rshares	pct	time
mimismartypants	0 B		52,020,416,067	60%
dustbunny	0 B		6,931,941,887	1.87%

@mimismartypants · Feb 20 '24

![](https://media.tenor.com/h5wN2y6i-p0AAAAM/clueless-cher.gif)

properties (22)

`author`	mimismartypants
`permlink`	re-penderis-2024220t92619470z
`category`	ai
`json_metadata`	{"image":["https://media.tenor.com/h5wN2y6i-p0AAAAM/clueless-cher.gif"],"image_ratios":[2.268041237113402],"type":"comment","tags":["ai","tools","discovery","local-ai","chatbot","proofofbrain","hive-engine"],"app":"ecency/3.0.46-mobile","format":"markdown+html"}
`created`	2024-02-20 07:26:21
`last_update`	2024-02-20 07:26:21
`depth`	3
`children`	0
`last_payout`	2024-02-27 07:26:21
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	63
`author_reputation`	81,104,231,720,459
`root_title`	"All the Inference"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	131,440,240
`net_rshares`	0

@pizzabot · Feb 19 '24

<center>PIZZA!


$PIZZA slices delivered:
@mimismartypants<sub>(3/5)</sub> tipped @penderis 


</center>

properties (22)

`author`	pizzabot
`permlink`	re-all-the-inference-20240219t093610z
`category`	ai
`json_metadata`	"{"app": "pizzabot"}"
`created`	2024-02-19 09:36:12
`last_update`	2024-02-19 09:36:12
`depth`	1
`children`	0
`last_payout`	2024-02-26 09:36:12
`cashout_time`	1969-12-31 23:59:59
`total_payout_value`	0.000 HBD
`curator_payout_value`	0.000 HBD
`pending_payout_value`	0.000 HBD
`promoted`	0.000 HBD
`body_length`	104
`author_reputation`	7,437,387,776,134
`root_title`	"All the Inference"
`beneficiaries`	`[]`
`max_accepted_payout`	1,000,000.000 HBD
`percent_hbd`	10,000
`post_id`	131,414,497
`net_rshares`	0