What would it take to create /r/localllama's own LLM?

A Reddit user expresses concern over the potential loss of access to open weights for 96GB to 128GB hardware and questions whether a community-driven Large Language Model is feasible.

• The proposal suggests combining open source models, training data, and distributed hardware resources from /r/localllama members.
• It envisions using an LLM with RAG context of papers and code for SGLang/vLLM to autonomously code a better model.
• The author asks if any existing group is already undertaking this collaborative effort.