Linux works well for most jobs, but to get it to work great requires kernel tuning, and that's never easy. ByteDance has a proposal to make this easier.
In another case, ByteDance was able to optimize HTTP network latency on an NGINX server by optimizing the tuning of 16 kernel sysctl parameters. In its best scenario, the ML tuning gave the NGNIX network performance a 12% boost over expert manual tuning. Again, that's a significant improvement.
Near future really. Supposedly the algorithms for chatgpt4 are going to be many levels above chatgpt3. I would imagine coding algorithms will follow suit as openai keeps updating their stuff.