roadmap: Cortex works on ARM-based SoCs (i.e. Raspberry Pi)

[dan-menlo]

Goal

• Cortex should work on Raspberry Pi and ARM-based SoCs
• This will likely be the future direction for Cortex
• Likely Sprint 27

Tasklist

• Build cortex.cpp and cortex.llamacpp on linux arm64
• What hardware is needed for this?
  • Raspberry pi 5 for testing on real device: https://mlab.com.vn/raspberry-pi-5-mlab-com-vn
  • Orange pi 5 for testing on real device: https://orangepi.vn/shop/orange-pi-5-plus-32gb-ram
  • jetson xavier agx https://pivietnam.com.vn/nvidia-jetson-agx-xavier-developer-kit-deploy-ai-powered-autonomous-machines-at-scale-pivietnam-com-vn.html
  • More mac mini silicon to creat VM linux arm64 base for CICD agent
• CI/CD pipeline
• Update linux installation script by including arm64
• Installation docs update

[hiento09]

Build cortex.cpp and cortex.llamacpp successfully but not able to run it