TodayToday / Industry / StoryInference optimizationShareMon 9 Nov · 11:27 PM, updated 10 Nov · 12:08 PMFirst seen Mon 9 Nov · 11:27 PMUpdated Tue 10 Nov · 12:08 PMLimited coverage, taperingIndustryReported by r/LocalLLaMA2 sources ↓A LocalLLaMA community member asked for hands-on advice on learning inference optimization, saying they have a 4070 GPU and 64 GB of RAM.Key pointsThe poster is seeking practical tips for learning inference optimizationThe poster has a 4070 GPU and 64 GB of RAMThe poster says they have read much of Philip Kelly’s inference engineering bookSourcesOldestNewestr/LocalLLaMAMon 9 Nov · 11:27 PMRead ↗Inference optimizationr/LocalLLaMATue 10 Nov · 12:08 PMRead ↗Strata after heavy optimizationsDetailsA user posting to the LocalLLaMA community said they learn best by doing and asked for advice on inference optimization. They said they had read a substantial part of Philip Kelly’s inference engineering book and have a 4070 GPU and 64 GB of RAM.Written from coverage as of Tue 10 Nov · 4:08 PM