Harin Sarkar Kayayyakin Kayayyaki na LiteLLM: Yadda TeamPCP ke Amfani da Kayan Aikin AI na Baya

Haƙƙin mallaka: TeamPCP

An bi diddigin mai barazanar da ke bayan wannan kamfen kamar haka Ƙungiyar PCP, wanda kuma aka sani da PCPcat, Persy_PCP, ShellForce, da DeadCatx3.

Halaye da aka sani:

• Yana kula da tashoshin Telegram a @Persy_PCP da kuma @teampcp inda suka yi wa kamfanonin tsaro ba'a
• Yana aiki a cikin tsarin halittu daban-daban (GitHub Actions, PyPI, npm, OpenVSX)
• Yana amfani da yankunan rubutu na musamman ga mai siyarwa don kowane mataki na kamfen ɗin (misali, checkmarx.zone don Checkmark, models.litellm.cloud don ƙaramin yaro)
• Alamun kayayyakin more rayuwa masu daidaito: maɓallan RSA iri ɗaya, tpcp.tar.gz yarjejeniyar sanya suna, tpcp-docs-* Ana amfani da ma'ajiyar ajiya ta GitHub azaman ma'ajiyar bayanai mara tushe
• Ana sa ran kayan aikin tsaro su zama wuraren shiga hanyoyin samar da kayayyaki na ƙasa

Amincewar ikon mallaka: Babban. Makullin jama'a na RSA da aka raba, tpcp suna da kayan tarihi, haɗin gwiwar kayayyakin more rayuwa na C2, da kuma saurin aiki a cikin kamfen ɗin na kwanaki biyar suna haɗa yarjejeniyar Trivy, KICS, npm, OpenVSX, da litellm da wannan ɗan wasan.

Motivation: Wataƙila kuɗi ne (satar walat ɗin crypto, samun kuɗi ta hanyar amfani da takardun shaidar girgije) tare da shahara (zagi ta Telegram). Faɗin tattara takardun shaida - daga AWS IAM zuwa maɓallan maɓallan mai tabbatar da Solana zuwa saitunan WireGuard - yana nuna mai sha'awar kuɗi wanda ke neman haɓaka ROI daga kowace yarjejeniya.

Taimakon AI mai yiwuwa: Na'urar tattara bayanai ta ƙunshi sassa 15+, waɗanda suka haɗa da maƙasudai na musamman kamar maɓallan sa hannu na Cardano, saitunan WireGuard, da takardun shaidar Kaniko Docker - ta hanyar da ta dace da ƙididdigar taimakon AI. Saurin maimaita nauyin aiki (nau'ikan abubuwa uku tare da tsare-tsaren ɓoye bayanai daban-daban), daidaitawar tsarin halittu (tsarin halittu 5 a cikin kwanaki 5), da kuma OPSEC na aiki (yankunan da ke kwaikwayon masu siyarwa, ɓoye bayanai na haɗin gwiwa, juriyar tsarin da aka ɓoye a matsayin telemetry) yana nuna matakin fitarwa wanda zai iya nuna ci gaban da AI ke bayarwa a matsayin mai ninka ƙarfi. Wannan kimantawa hasashe ne; ƙwararrun masu aiki za su iya cimma irin wannan iyaka ba tare da kayan aikin AI ba.

Sabbin TTPs da Dabaru

1. Guba a Sarkar Kayan Aikin Tsaro (T1195.002 bambance-bambancen)

Na'urorin daukar hoto na tsaro (Trivy, KICS) a matsayin hanya ta farko ta isa ga wuraren da ke fuskantar barazanar tsaro wani sabon ci gaba ne. Maharin bai yi wa dakin karatu illa kawai ba - sun yi wa kayan aikin da ƙungiyoyi ke amfani da su lalata. Tsinkayen Dakunan karatu da aka yi wa lahani. Wannan yana haifar da makanta: na'urar daukar hoto da za ta kama lambar mugunta ita ce kanta hanyar isar da saƙo.

2. Python .pth Tsarin Fayil (T1546)

The litellm_init.pth dabarar da ke cikin v1.82.8 tana da matuƙar rikitarwa. .pth fayiloli a ciki site-packages/ ana sarrafa su a kowace farawar mai fassara; kowane layi da ya fara da import ana aiwatar da shi azaman lambar. Ta hanyar ɗaure nauyin da aka ɗora akan guda ɗaya import A cikin wata sanarwa, maharin ya cimma aiwatarwa a kan kowace hanyar Python - ba kawai lokacin da aka shigo da litelm ba. Wannan yana nufin cewa kayan aikin yana ƙonewa ko da an shigar da litelm amma ba a taɓa amfani da shi ba, kuma yana tsira daga gyara wanda ya maye gurbin wanda aka lalata. .py fayiloli ba tare da an duba su ba .pth fayiloli.

3. Motsin Kubernetes na Faɗin Layi ta hanyar Shigar da Pod Mai Kyau (T1610, T1611)

Ƙirƙirar kwasfunan da suka dace ta atomatik akan kowane ɓangaren rukuni - tare da hostPID, hostNetwork, tsarin fayil ɗin mai masaukin baki, da kuma chroot don shigar da juriya — jigilar kwantena na sarƙoƙi (T1610) tare da tserewa zuwa mai masaukin baki (T1611) don mayar da aikin da aka yi wa rauni guda ɗaya zuwa cikakken sulhu na rukuni.

4. Mai Sayarwa-Yin Kwaikwayon Kayayyakin C2

Amfani models.litellm.cloud (kamar litelm) kuma checkmarx.zone (yana kwaikwayon Checkmarx) kamar yadda aka tsara ƙarshen C2/exfil don guje wa sa ido kan hanyar sadarwa. Masu sharhi na SOC waɗanda ke yin bitar zirga-zirgar fitarwa za su ga haɗin HTTPS zuwa abin da ya zama halaltaccen yanki na masu siyarwa.

5. Saurin Saurin Saurin Saurin Saurin Saurin Sauri

Buga v1.82.7 tare da aiwatar da lokacin shigo da kaya, sannan v1.82.8 tare da aiwatar da lokacin farawa mintuna 13 bayan haka, yana nuna mai kai hari yana sa ido da daidaitawa a ainihin lokacin. Bambance-bambancen nauyin da aka yi sharhi (tare da tsare-tsaren ɓoyewa daban-daban) da aka adana a cikin lambar tushe suna tabbatar da ci gaba mai aiki yayin aikin.

Abin da za a iya yi

Wannan harin yana amfani da aminci a kowane mataki: amincewa da kayan aikin tsaro, amincewa da rajistar fakiti, amincewa da yankuna da aka saba gani, amincewa da CI/CD sarrafa kansa. Kare kai daga gare ta yana buƙatar taurare kowace daga cikin waɗannan iyakokin aminci:

Ga Masu Amfani da Kunshin

• Dogayen abubuwan da aka yi amfani da su ta hanyar hash, ba kawai sigar ba. pip install litellm==1.82.6 --hash=sha256:... da zai hana shigar da nau'ikan da aka lalata koda kuwa sun bayyana a matsayin sabuwar sigar ta ɗan lokaci.
• Yi amfani da fayilolin kulle. pip-compile, poetry.lock, Da kuma uv.lock kama ainihin sigar da hashes. CI/CD ya kamata a shigar da shi daga fayilolin makulli, ba daga masu tantance sigar da ke iyo ba.
• Saka idanu don .pth fayiloli. Dubawa akai-akai site-packages/ don ba zato ba tsammani .pth fayiloli - suna aiki akan kowace farawa ta Python kuma tsarin juriya ne wanda ba a yaba masa ba.
• Aiwatar da sarrafa hanyoyin sadarwa na fitarwa. Fitar da ruwa zuwa models.litellm.cloud da kuma zaɓen C2 zuwa ga checkmarx.zone za a iya kama shi ta hanyar tace fitarwa bisa ga jerin izini a cikin yanayin samarwa.

Ga Masu Kula da Kunshin

• Fil CI/CD ayyukan ta commit SHA, ba alama ba. LiteLLM's pipeline An yi amfani da Trivy ba tare da sigar da aka manne ba. Da an yi nuni da shi aquasecurity/trivy-action@<commit-sha> maimakon @latest, matakin da aka yi wa katsalandan ba zai aiwatar ba.
• Yi amfani da alamun bugawa na ɗan gajeren lokaci, waɗanda aka tsara su da tsari. PyPI tana goyan bayan Amintattun Masu Buga Littattafai (wanda ke tushen OIDC) da kuma alamun API da aka zana. PYPI_PUBLISH Bai kamata a yi amfani da alamar don samun damar bugawa na dogon lokaci ba, ba tare da ƙuntatawa ba.
• Kunna tantance abubuwa biyu akan PyPI. Bukatar 2FA ga duk masu kula da kayan aiki kuma yi amfani da maɓallan tsaro na kayan aiki inda zai yiwu.
• Kunshin alamun. Shaidar Sigstore/PEP 740 tana ba wa masu amfani damar tabbatar da cewa an gina fakitin ta hanyar da ake tsammani. CI/CD pipeline, ba ta hanyar wani mahari da aka sace ba.

Ga Masu Aiki da Dandalin (PyPI, npm, GitHub)

• Gano tsarin bugawa mara kyau. Sabbin nau'ikan guda biyu da aka buga mintuna 13 tsakanin su, daga wani IP ko alama daban da yadda aka saba, yakamata a fara amfani da na'urar daukar hoto ta atomatik kafin a iya shigar da fakitin.
• Haɓaka Karɓar Amintattun Mawallafa. Buga littattafai bisa tushen OIDC yana haɗa fakitin zuwa takamaiman ma'ajiyar bayanai da ayyukan aiki, yana sa alamun da aka sata ba su da amfani a waje da na asali CI/CD mahallin.
• Aiwatar da na'urar tantance malware ta lokacin bugawa. Za a iya gano nauyin biyan kuɗi na base64 da aka fassara a cikin proxy_server.py ta hanyar nazarin tsaye a lokacin bugawa.

Ga Tsarin Yanayi

• Ka ɗauki kayan aikin tsaro a matsayin muhimman ababen more rayuwa. Miliyoyin mutane suna amfani da KICS na Trivy da Checkmarx pipelines. Ya kamata a sanya hannu a kan Ayyukan GitHub ɗinsu, a manne su, sannan a sa ido a kansu da irin ƙarfin da suke da shi na fakitin da suke dubawa.
• Zuba jari a gano lokacin aiki. Binciken tsaye kaɗai ba zai iya kama kowace dabarar ɓoye bayanai ba. Kula da lokacin aiki na shigar da fakitin. hooks, haɗin hanyar sadarwa da ba a zata ba, da kuma tsarin samun damar fayiloli masu shakku suna ba da kariya a cikin zurfi.
• Raba bayanan sirri na barazana cikin sauri. Da ace an yi amfani da tsarin daukar hoto na awanni 5.5 don litellm, da an yi shi gajere, tare da saurin daidaitawa tsakanin masu siyarwa da masu siyarwa. Ayyukan daukar hoto na atomatik kamar Xygeni MEW, Socket, da Snyk sun gano matsalar - matsalar ita ce lokacin tabbatar da mutum da kuma lokacin amsawar rajista.

Kammalawa

Yaƙin neman zaɓen TeamPCP lokaci ne mai cike da tarihi software supply chain securityTa hanyar yin amfani da na'urorin daukar hoto na tsaro da farko da kuma amfani da su a matsayin matakan hawa zuwa ga kayayyakin more rayuwa masu daraja na AI, maharan sun nuna cewa sarkar samar da kayayyaki tana da ƙarfi kamar yadda take da rauni a cikin dogaronta na ɗan lokaci, kuma wannan dogaro na iya zama kayan aikin tsaro da kuke amincewa da shi don kiyaye ku lafiya.

Yarjejeniyar litelm ta nuna ƙaruwar haɗarin da ke tattare da kayayyakin more rayuwa na AI. Yayin da ƙofofin wakilci na LLM suka zama standard tsari don enterprise Tsarin AI, suna mai da hankali kan samun damar shiga maɓallan API, takardun shaidar girgije, da bayanai masu mahimmanci a cikin wani ɓangare guda. Yin watsi da wannan ɓangaren shine maɓalli na kwarangwal ga dukkan tarin AI.

Ƙungiyoyin da suka shigar da litelm 1.82.7 ko 1.82.8 a lokacin da ake buƙatar aiki na awanni 5.5 ya kamata su ɗauki wannan a matsayin cikakken sulhu na takardar shaida: juya duk sirrin da ke kan tsarin da abin ya shafa, duba rukunin Kubernetes don node-setup-* kwalaye a cikin kube-system, cire duk wani sysmon.service na'urorin systemd, kuma duba litellm_init.pth a cikin Python site-packages/ kundin adireshi. Masu amfani da hoton Docker na hukuma (ghcr.io/berriai/litellm) ba su shafi ba, domin hoton ya liƙe abubuwan da suka dogara da shi kuma ba a sake gina shi ba a lokacin da aka fallasa shi.