From 75878f27c88c2ffd296425d94226d0dc9bd42518 Mon Sep 17 00:00:00 2001 From: zijiexia <37504505+zijiexia@users.noreply.github.com> Date: Wed, 21 Oct 2026 08:58:16 -0700 Subject: [PATCH] [Doc] cookbook: Add Recursive Flint cookbook (#45625) --- docs/cards/logos/recursive.png | Bin 0 -> 11180 bytes .../autoregressive/Recursive/Flint.mdx | 151 +++++++++++++++++ docs/cookbook/autoregressive/intro.mdx | 6 + docs/docs.json | 6 + .../snippets/configs/RecursiveSI/flint.jsx | 153 ++++++++++++++++++ 5 files changed, 316 insertions(+) create mode 100644 docs/cards/logos/recursive.png create mode 100644 docs/cookbook/autoregressive/Recursive/Flint.mdx create mode 100644 docs/src/snippets/configs/RecursiveSI/flint.jsx diff --git a/docs/cards/logos/recursive.png b/docs/cards/logos/recursive.png new file mode 100644 index 0000000000000000000000000000000000000000..ab475089384cd6e734c360a84f02c63517f55384 GIT binary patch literal 11180 zcmeHt`CpRh8!lOCR_c^vO>Q+aD3zIQW-e%H8!l+B(Hr<_xa6W>zMG zl7c&GtAkov3M6hhxs0Gg150y;rJGqyAQmL<+nr*o++5Iv( zvpSQ0;J~GQKRa)$I%ZGMm9&2DDp+NR2an>4mJ*1}LaTSBG{5y&4}r8TFWiG#RGqrQayX>lon-iZu z(U<7OSo`CXA>!bXC)bzfb2sxzho3JtL-p2vAm4c#+@`tnbdy@&k?wd0V)4SJ+HRQf zLFTPtZEzv`v?6ggV*c-3V^-J?3^>!fu(jzFv6N_L{6ua*+N7dm+#|dEDdK8git7>&Gj;iKYessu-OOGPcUe%(LN{d&9~t%gJ8WRi39<55 zf*vsNyio#-M^Zdm8Vl=>y)~Oycx+@j11hnLqyWLlDU6K4eqSWrS%1XT%BAxyv4A5~ zFX+q&F`d~6EYxG)5HnF-gd_Q&t{b!HbQ@xR>f)DNK(aO+n=VA+sXHyLGG2vovBsPrsYdU6s_2 zro?H(wVUSfrPl}cG-tQ37hM^OqP~x+^(WrJzpL}k^W$R-egZZgj!qfS`&HS^L?^T# z&QyVE?qx}r`^Hx5Y=EGLHkNXenq1hYDyFs57^bOqK{sdL)nyCfIJBKxz|ZNr8`-B= zk#pZ3LOmX7=>@AryQD9%2h_LD04p2~^>mnV-PJ^?9`9D=UphUf#e#OzL*+CtoU^?$SIr0J}spoV(d&i zyvTy`*qVF!;WM`uQ=Tx;5XiN-P2`k4CiQo&3~Y4wZyKGs4$Xh8r2$(S%-u0H`Y9eq z9QyB^M2XPdf|xDp*>C!^rR9&YdimLqnf)cw`Jxi(3uwMQ{yC6ZUxCd@!(_opz5550 zNH2e0EP*OK(bsu3()%kdhcox}jio7YzpVm0tYZ4Uue*P$eV;UpSoq=IcJ4^dSig3O zbQBt1xOg2XII)ka98x?+Dxy>e!upTR?8PrRcK57Ep{C!j68?x%P(B~!lkVCdNYr$y z$fSJynP~_Ygu`LXj_=+nlEVgXlAi2#?cW|Y@<(m+KIVG3r9_A@4{1>Y&YP0M*10Se zfD7Do`zuR~$~CJON}%1MO*1O&j$=R@8*oKO*MtZ@>Ct_@8et`Hz)0YAfkCaunfH3V z4*^ZgHnNk~^Dzyd-Tf6#ReEOOPWuWeP0)stz@XJA-&9ASM^^$`i`J0{Wo{|#F{yM} zdDsAUh z5H0q}(das8o$b>TF|FqM%-b|yA#~?Lv-~9Qjq+oVu(?ZZCJ_$Ab8j|q!bGCqp#p1< z82kAY;GG4i#(yTe1LC|7lU~@jAMZhgf5=WTEg`UOSd|x9M`bR#$|BnKD6spVV}Ap) zjF3l0Zg1yWyzduSraI2R*OH>k39YqPt#7v|D2q_;8esDg``Xp;u2^v_S1f^selR2mUobp`29Imlqr&__ZA|diRW2y{R4- zW-r4Nl6%abwwM=<9TI{{aPm%oAyqk(%?Y;;%9@dH*urNWrl2lVE$-UMZNj&L68e9g zKp+mXN?jIjLfc{ehh{z=XO07>86c|1|1)0Ce!L$MW_l{x^Yxc9gtD#2VmWN1!H?Wd zVFvc*4xo9zI}(^U0~&bm{*-3ri9{nN64Nd(LbA(DB!svw?3W;-)xX)WnY?}g)=)i} zz&A#?KGD*l6(81ps_f>I^zmbfGYE?U)I0E~R;bu6C`-$EPqF=c@*8BIeu*@%NJ#Oq zseb)GsSFKoWFJ}%0cpP$p_$Ub0pAw-x46sSV<#{|j>dN#mfYW$@%c_Wd5$%!@-c_*%u0TtCi#2ilTFxAP+@)hT<#R~Sdi9)s(+ zRs3C^-S*Y}|A`XqE&K{KxMIn#ckOQ?PUqKV_N+LhTa|b4aRqCk;o4;dqLl2qT_#O7 zh*C9fI{(HZLP$|z{UIx8F0!2LD12m;_E9|dd*k?*a;QexP>*@J-Pc=OS6L9N34a1v zYd!y0?tb68<>k}Fm%Z6uykwhFOUYb`b08J2N;hOnFVq~{fc_pIy<(lF&JG9nJk4cjW=>?bI9e`Fr;!C9L!xF7T{gzC> zj5P}eWwe=i8*6=~m3%r55_lqhIl@L6G5=5Q18!kB!GsCS0rKyT9oh@kkS-d4S6y$Q zdTaIGR>S_lO(OcWet$@68+XJUG0QtVvTRBGoDq^+YbmLVzqR-uu5}i-H3oFh51xa@ zRjab!xM=Q1&a-L$RnXW)kUE~B6(F@xdUAa3J_V)1_rlXdfDH_ygI33H^q61Ox29Tr zkYOwJ_y%@#4S}eKuk9$x@bkCY-RlUKe#?De;z?lq${b!x8EP}g@@%}>Nbd1wb0$G` z!b3sruSsIUgJ-ut#~>>I*~M-3n!E&xSAYq1cIYFsQRjws#@PLBr=m~1%8tOF%5BXbM%Pq!^{ptC-#!VnM=yXcG+PKs-9%S`ZeQlelf7VRi zRf&;j!%aACTiFqKqFb4gDQkVs8@j9z1hP{K+%GK7-vq&IK`I6;=Gy%&WP`M)W{LC? zi1-OqMU*SEI9{Xth{|;CSfebR?Eg*ju6q|1$)y2W#n$t)v`a6c?a?G=#)O9eSsl)G zoQM_())2D5uXN2Hxh)sBkW1y>ss!Uhw{(m;?pz?BSh+|Hl|hk(=VaE-%`@rHxb`)P zZ8-_65_>}9Ms}orDaYuFmhFAc zx2u6k26i7~jW5J@)5b#)+OuCeZ_jsIIC|V!2f1c^NH00s0g>l0>S2imZlbWKrk>`o$ z+MQ8NRsE$RyhpVMJOa}vG5h9T;8X$l_DNr${k^;kgHYy0IQNDdE3U_NLeoaHKr49w z(69EjYIIWx;X?vnDC#J19gYQccNf6WA>MPVErld}5>cuipK3Gy^+OSkvGaJ$!!X4e zn2J`*v4b>=%rU#Q;5}5FY#9AUB&Cy%e-oz;oU{3Bz-;Ctj9CZ=WFp8{tzAFE^TSb^ zPrhIKcTcyrnNXu%l{c17X!_XBm%O`#?DXny--amSP0PSwRNlUC2xplEG^f-43^!Rr zIpI!JlS{jTt|s!>)x=ooeac=OBk(TfckRj(*?4R$(nGm|vnMTnq=_{VHNWs)N%{hm zfQhqPlIi&LNs=~TQg4u1LkF2^s(@FWn$=62A$*1w&&KU#!4Zqa-;KM4JoNJS%6}qL zr)m)QLdZPV7atiw2YBtXC3Yy$a~Rhm;>EWcfU^17eG7SgIAUJ7?NaE8zlO5?IJD9Y zbH2eE)0TJx*uK`oq5F!5n&RKp6?yB?Kv3NcHl*&*&{^{ACJp59Y=iVVPFV$t3&I&s zK!VHD<5&7}dsd<*>3c_T&c0bO5J=G3P5@Y`P@_eF>ebJWj}{U=IpF>+X@yUl5JSCB zd(3$!D>?s#QgW=$l7IS~qr0`(&cm87u!39S@4$H3ye}?ry_p zLp|L1tNW_>kqGa94v)mgrj!s?P3oF@l0C=2?2eom_>g*9LsADxhIz7Z$DGa)KrpJs0a`4>dLm?e`C=6}#b_ zBM;Ox28w{L|KkT;rE$vS$-9c=40rz|XU-6@4z~0`c=?MJ=a~i9GGrkw`oS-Rdb|ZtPJ#0os*w3p?Ygj zldB-d7o<$>`6Gc|+c7+Rw7J0frMF(~`KT|TNsM^?#Usr{v(v!ZoH+JcTS!UQHTIJ+ zrE6?Oa)kn0$m2V5y;UeR6{Y*hLv!=zi7CC=j?xzTxgdjX`!Mp~^%td@cS$sr)*W>^ zaiX=7MA?oy2jFk}E2PF|J-|Mba{cOP^VsJV`_Av$BZhsm5q8GS!z=CEh@cdr6zv<2mqaX8`y?h$SF%~F-tXV zXQTWipz)#8PK~-H($ch>i`!qcnqO+6YjDG@tNCm4ciwMnocK<+?i&AwInkWZT4X*5 z$Y%P}*qVdKM%*nW10S-7VBb}Epgpz$G=@JXN6)P1w<#kkr~3Efk;E(|g0&GcYB_g_ zJ<1r#9dp6h7$cUS9WG&b#3lXA{F3I94;;!+MRDL%<>sH6>t)F}I{q^4X3h-J^Zij; z@c=5wAl0#uD|8?g>l#O_Ic3}u?bY0tr)~)b6H%mIvl{lB0qbk} z8de;-vw1rswSgXK8%`)`#?z!aj;kPHl$5HFVzSTkQH{($8KyJO{nJrj<$6h zD(B!@3-A!2E9i`3?k5GSJYAQ-`fdN`2<-G>CGA%Wg^leO)Y!A2bNT5P>Olgag>WWC zm3yPfr`UVICMQEHSZ}U=7khT)UD)(oiQ~^JeRAtu&>JDwHf|#Kf?6i9p8uG;hePSg zTAwi7v=!vi^9w#dZT|c7{=ba+c5z%Y#S=q_qMw9`%5}*VR5?i7208x1dj5l7VtF^v zy-IKkjBkAD$;{AJb6HZX^TZz9)hLp2>uADJ~CSuR|b)&MFV zD-H@j$X`XJ;7B>5gzlESv6qFMGdDpWsQUvdP>-rSoi$bo6fQ3KyS#Bgr{Q5Bs%Z~% z0&_0zt;JBy{*}_@q8<1v-g?RZ{sVML?jh;q*cxTIPZ4|6Z@g^J(5$^7q~!ORIs7dwt{tO#g62(^X|?^7`n?WpuK_JuS6b-xcVmdY&e!qvmckJ`tBd8QbnzUJlLHay|^A*CtV~J&D4#YuO9zp^&9AU`hO*7 zO_td{vx_5q+|Sg3`$zy2PX85H?4-RMe;$OH0<@v(T*QG>yfLT-<#YEyt@hk8$^$dI zl-_(dQLYn%@~-UQX_;I_8`$GJQ3{lX-RI}O-O%%s|CzrN+n?w0f*Xj}-hTxjniKk3 zK3ccFyMU)Enq{?Y0Il3V2((ub$YOsY?v1lWs+Ir9%XDj$X|w#Zn=iPZMfe;Zwd^s~ zP3aS1!r6kpgVHSr80rF)dQbo$*@>tTUprG|F&cm0P!U@k8iJ(LjwDq~Vy|L|6wdtQ zCNh}yWVCV5qP0#OV!njS1@;Tui6N-f;p2ukM2gsvavTM;gMkE}+5Tm-di&^5#ee_d zinfFMP2E8LRq$h*wrx}xm<2UuG#?K&hB8Zi7fsE|8d3j=QVVpp9uVBLQe(Tl>3V#R z^hUX5bqadU@OYU!QplhO@`ac?gUbiLn-tpwv=u`wcpF%5XF;Pa2{$4W%$d3vEK;O_ z?OATF#gQ`pCwL+d{MoJQu*agT!&_-jPymWpDmy8@=)2TzBsTPsEA$tW2_IlT6wF{)xE^PetvXWwC8D2~#P9zU! zHI6!*iN5M8yk}BzQF%|WzhJlB{18&j(06fVcSZuK_T>7uhd%%fnv)y_KMsYzA_v4G zMM*kKy6um1yWkbOUkwItMGKNHtd~48 zX0;;cyVdiY^iQc>+oemDJ0uwP4m9i(9liJo`5r`Yp_0q!u&dQ_{+nsIh@W&m>as7T zRgX6qiHTiYO$8iuo%{8iTAi;hqOp++Gpz=(>SfI`?*R)SYFS{z>s8TMo3;Q zaO(SaiA}3BSz<7(mw}ocTE8aGXU4cJUUa0yAg-bEkOAJUOrPG^h^d>p=`PfVap8tkhqT)YgNyF-!8 zH=t(kdaLke11;<-{y6g);`n)wqm35%RPm_@ye?CsF(5e`y%$0~xo-llD5PQtb%72RM*j|WvrUufK4^U$ zNnkU71@_=BcAb9NtCnA9-j=s~tdY`bh&n$z<=$m)%1Pj!J15azC#bVdf=*42+_K~3 z2+op`TB8MU=@#^|B6w=TdXi{iMxr#)e@0`&l0wVb__ej!goF05hYg7nj^COj0on z+!~9G`-NJmjdHUKS|^PmQa;>sV>yL_ZBWtBr-EQ(TmC!k)<=6mb1{8LA6S3K2KG%o zvIVj_mfQGbd=Ma%(XkU{jnPEGLV=U?EK&cv2ySxxubZ(LRYJIx8$Hu?*cXcxSmH=3 zhF9%uFrUpsgIYf?CgF+j@26ws`2TF?PZC24Vww*#rSJ*o&Jvq;8Ll>)GF9O!y(S^t zJ7C0695 zfc=5wuEG)CvUAjC0IS#NxRXRIzj*=_$JKlp+&_6{%!)eS7n{-SpDbN1hQf3kUKZ>J z#`4)u?ks)L=&M8mQP_>0GiSN6Y9}t>NH1}Xfvgw|D3AA5QGuq^>`$V{GM^irC^JbY zo__Qok)X5)W;wqCs=Afzj}(1`b}#1kev2czQiT!Nqi0YspiIUI?z z%C4hjOHJOiJ3@DKH<&+RUGJM%7husunOwj6KX9 zX@uLco}bM7*^^g50s2|S@v-GQ5-&X+q7ST?0G@{RE&jWD^(g+`)bPho1qZ>P;8vRn zqs@K7d8Bx33dpQrxVZ12Bxyu_x|MG11qsO9p0>CRg$ECP_YdZ{QC z5o7Oh968^hh-;(>c3<;9ZF2}BeAtC)F=8qqVze8x9}jHy&`yUM>oBDl?5Y4cpM&sr z@*pIc(pJ?({8mJiBN1QL8~_Y{_9?Zpbu*t&9E3l){WWTmKR@|9;<&ZPB69w-w#3I} z(phS$0WvbJt?_GebQ9EVp`f?<>2qTih3NSKw>m-^QGr0_6gIG5Zy`UXi0&5Q^1w_W z+PApf@n@+Y2yX7G7F})&?XBMoYzh?1}f$!SIs{V}x>4`+#o z)m@Xk#H~z+2>sRR1*oKtV}k;5zT=V3)fxBeorH%u_PM>&wXKQ2GPBbNJB+G?b)}V4 zyNa9`%`M(wzK=bP_Nr+!;hDdW6qgUXS4CkE#>}rbkb4S`mBrgrp31dVU%sVwZTv)8 z{OLlcq3C4E>D6_z^NeF?Wyw=oUBIi_VFz3}$Dl5-bYFUL)1w23K~Uk7`>h-ZaqnFrtm{pTOUK=)DTU;9e zxu{MY1G_30ZZ(EzATDrX{LHNQzQIV`MBd^i3s!B6Ag>6F6b8UvoQBwaVy$cl&!N5G zRB*pNG|pZrR)3%P>2NPN(0p*WVHv<_+dFN`67=zeVqO_BWbk8qwP!Cbx*HqcAu|8I zuWd`n7q>N%imsYoRXP|73dHtiu(h}AwnN0^%L*xE0!~dVuMvZdcvdZ7xZrICR{29^ z1=e%^3Yb!@)%k0cV7xYBJ8w&Tsb1hTWD4f6RZ~mgHH+`NvP(iul(?MJNb}2w=7<2A z1f*~lKoBV1pKRk2)ez=GIHagnzG@2GrVcv8aE-p~iFQ+$z8qa3?bkJP_vExSCNOlF zGcpYMOmn{pq74Q19OHqV(2;)tLyP7#g0tW+V2_5E;D(iWM;!Nw% zr}!A6-FI_6-a|!pcR+o1k)GbmcVZl5BAq-zSKLNaMU@>bTYe7hP74xig>6jS%hV{N zo&_tAasVLgb%{{R-=EO=G9u@N)Ch6ZZewfj2MN}us-j|}eJ zchcIxc`nq*n65730IZ^hY$Eg9^B%Wm8&4Ld?^LCY4e#8;bvW5`2BY7VTAM z%=(r1t=j1f0n@e42Fy2KDQt&89$0{Z9hj@!)5ej;BZG-)344K;*>}O7tJXRS0}wD= zr=Kf3iJsX+mXgm$SqC1E{!kEH-aI?C9=x|j4Fkl4QSt7Z^x^lfK+!r!g0T9{JT%;ADPO^BsLu&3TUV=M?q0*~ueBv;)pZEM65^UpTR zmnx%x?d`H7LcveCnXGNF;UcH1NQ^NxEPG53V1JcO^~>#KAoI0*VH+cVV0)Ky>NP*0 z(fX^ipEH^dJsgUySNpmGRUo(1!4nQWf7-()B-#+&jJBgjGRKmEg}}Q)G1fI;d=GIR zneN|#Pb9w0!JvosF=JuVH5#7Xl$jUcx2|hm#BXTJ@h^{&J*J7<){ieMlk;_#KJ>J_ z**Fh2g3aeGcFGiwi6FMOJ8L&}@3xKlv{iwvMAXaxFIWI31dHSUG7UoLnuuJWoWOIa z$H%>xYA}6=LhHx=HO%ovie5u^AC}b*>bH=LG4Q5MF&1wzby=Q0li}G9)-t(Hviw`| z&KaB4R_g@u?llmZbA%dJFxGV#M@so*ay1bw!`Oct0&&r2vwm1!QPr>H*~GorJJ z>~D8YH?F!pucNS9;MvXrXRhsX;Y?_O){SCg!MZVK7I)cFPoTHOOxMfF3Arhe!U52JjqZX}Sed?ojqon|!S&om4vark z@z@`{O$1?I#0)SJZ1V;6?GY}EUGeVV6%)vTMk#Ty=_Gb;u7Kx)s1?f)l-iONGc1P1 z#hmU8H) + + + +Flint runs on the `lmsysorg/sglang:dev-flint` Docker image: + +```bash Command +docker pull lmsysorg/sglang:dev-flint +``` + +For how to launch the image, see [Install → Method 3: Using Docker](../../../docs/get-started/install#method-3-using-docker). The **Docker** toggle in the command panel below produces the full `docker run` command; the **Python** toggle produces the inner `sglang serve ...` to run inside the container. + + + +Pick your hardware to generate the launch command. + +import { Deployment } from "/src/snippets/_deployment.jsx"; +import { config } from "/src/snippets/configs/RecursiveSI/flint.jsx"; + + + +## 1. Model Introduction + +**[Flint](https://huggingface.co/RecursiveSI/flint)** is a new open-weight **40B Mixture-of-Experts** model from Recursive, built for fast, local AI coding. Flint was developed using Recursive's Eureka Machine for automated AI research and is released under Apache 2.0. + + + + + + + + + + + + + + + + + + +
ModelTotal paramsContextUse
Flint40B (MoE)262,144Fast, local agentic coding
+ +**License:** Apache 2.0 + +**Resources:** [Hugging Face](https://huggingface.co/RecursiveSI/flint). + +## 2. Advanced Usage + +### 2.1 Reasoning + +Launch with `--reasoning-parser flint` (included in the commands above). Thinking is separated into `message.reasoning_content`, and the final answer is returned in `message.content`. + + + +```python Example +from openai import OpenAI + +client = OpenAI(base_url="http://localhost:30000/v1", api_key="EMPTY") + +response = client.chat.completions.create( + model="flint", + messages=[{"role": "user", "content": "What is 15% of 240?"}], +) + +message = response.choices[0].message +print("=============== Reasoning ===============") +print(message.reasoning_content) +print("=============== Answer ===============") +print(message.content) +``` + + + + + +```text Output +=============== Reasoning =============== +We need answer simple. Need maybe show calculation. User asks "What is 15% of 240?" We can answer. Need be careful maybe just 36. Let's craft concise. +=============== Answer =============== +15% of 240 is **36**. +``` + + + +### 2.2 Tool Calling + +Launch with `--tool-call-parser flint` (included in the commands above) to surface structured tool calls via `message.tool_calls`. + + + +```python Example +import json +from openai import OpenAI + +client = OpenAI(base_url="http://localhost:30000/v1", api_key="EMPTY") + +tools = [ + { + "type": "function", + "function": { + "name": "get_weather", + "description": "Get the current weather for a city", + "parameters": { + "type": "object", + "properties": {"city": {"type": "string"}}, + "required": ["city"], + }, + }, + } +] + +response = client.chat.completions.create( + model="flint", + messages=[{"role": "user", "content": "What's the weather in Paris?"}], + tools=tools, +) + +message = response.choices[0].message +print("=============== Reasoning ===============") +print(getattr(message, "reasoning_content", None)) +print("=============== Content ===============") +print(message.content) +print("=============== Tool Calls ===============") +for call in message.tool_calls or []: + print(call.function.name, json.loads(call.function.arguments)) +``` + + + + + +```text Output +=============== Reasoning =============== +The user asked for the weather in Paris, and I have a get_weather tool available that takes a city parameter. I should call it with city 'Paris' to get the current weather. +=============== Content =============== +I'll get the current weather for Paris for you. +=============== Tool Calls =============== +get_weather {'city': 'Paris'} +``` + + diff --git a/docs/cookbook/autoregressive/intro.mdx b/docs/cookbook/autoregressive/intro.mdx index 586908092c..3c5d4fa248 100644 --- a/docs/cookbook/autoregressive/intro.mdx +++ b/docs/cookbook/autoregressive/intro.mdx @@ -187,6 +187,12 @@ metatags: href="/cookbook/autoregressive/Tencent/Hy4-Preview" img="/cards/logos/tencent.png" /> +