In the context of system design, heterogeneity refers to multiple different resources performing at varying speeds or capacities, potentially leading to underutilization, bottlenecks, or system breakdowns.