The inter-lamellar matrix (ILM) has an average thickness of less than 30 µm and lies between adjacent lamellae in the annulus fibrosus (AF). The microstructure and composition of the ILM have been studied in various anatomic regions of the disc; however, their contribution to AF mechanical properties and structural integrity is unknown. It was suggested that the ILM components, mainly elastic fibers and cross-bridges, play a role in providing mechanical integrity of the AF. Therefore, the manner in which they respond to different loadings and stabilize adjacent lamellae structure will influence AF tear formation and subsequent herniation. This review paper summarizes the composition, microstructure, and potential role of the ILM in the progression of disc herniation, clarifies the micromechanical properties of the ILM, and proposes critical areas for future studies. There are a number of unknown characteristics of the ILM, such as its mechanical role, impact on AF integrity, and ultrastructure of elastic fibers at the ILM-lamella boundary. Determining these characteristics will provide important information for tissue engineering, repair strategies, and the development of more-physiological computational models to study the initiation and propagation of AF tears that lead to herniation and degeneration.