Nonaqueous organic electrolyte solution in commercially available lithium-ion batteries, due to its flammability, corrosiveness, high volatility, and thermal instability, is demanding to be substituted by safer solid electrolyte with higher cycle stability, which will be utilized effectively in large-scale power sources such as electric vehicles and energy storage system. Of various types of solid electrolytes, composite solid electrolytes with polymer matrix and active inorganic fillers are now most promising in achieving higher ionic conductivity and excellent interface contact. In this review, some kinds and brief history of solid electrolyte are at first introduced and consequent explanations of polymer solid electrolytes and inorganic solid electrolytes (including active and inactive fillers) are comprehensively carried out. Composite solid electrolytes including these polymer and inorganic materials are also described with their electrochemical properties in terms of filler shapes, such as particle (0D), fiber (1D), plane (2D),and solid body (3D). In particular, in all-solid-state lithium batteries using lithium metal anode, the interface characteristics are discussed in terms of cathode-electrolyte interface, anode-electrolyte interface, and interparticle interface. Finally, current requisites and future perspectives for the composite solid electrolytes are suggested by help of some decent reviews recently reported.