The timeline for building a garden office is typically 4-6 weeks, whereas an annex might take 8-12 weeks depending on complexity and size. Factors such as weather, custom features, and obtaining necessary permissions can influence the overall duration.