A flexible-base coupled-two-beam (CTB) discrete model with equivalent tuned mass dampers is used to assess the effect of soil-structure interaction (SSI) and different types of lateral resisting systems on the design of passive dynamic absorbers (PDAs) under the action of along-wind and across-wind loads due to vortex shedding. A total of five different PDAs are considered in this study: (1) tuned mass damper (TMD), (2) circular tuned sloshing damper (C-TSD), (3) rectangular tuned sloshing damper (R-TSD), (4) two-way liquid damper (TWLD) and (5) pendulum tuned mass damper (PTMD). By modifying the non-dimensional lateral stiffness ratio, the CTB model can consider lateral deformations varying from those of a flexural cantilever beam to those of a shear cantilever beam. The Monte Carlo simulation method was used to generate along-wind and across-wind loads correlated along the height of a real shear wall-frame building, which has similar fundamental periods of vibration and different modes of lateral deformation in the xz and yz planes, respectively. Ambient vibration tests were conducted on the building to identify its real lateral behavior and thus choose the most suitable parameters for the CTB model. Both alongwind and across-wind responses of the 144-meter-tall building were computed considering four soil types (hard rock, dense soil, stiff soil and soft soil) and a single PDA on its top, that is, 96 time-history analyses were carried out to assess the effect of SSI and lateral resisting system on the PDAs design. Based on the parametric analyses, the response significantly increases as the soil flexibility increases for both type of lateral wind loads, particularly for flexural-type deformations. The results show a great effectiveness of PDAs in controlling across-wind peak displacements and both along-wind and across-wind RMS accelerations, on the contrary, PDAs were ineffective in controlling along-wind peak displacements on all soil types and different kind of lateral deformation. Generally speaking, the maximum possible value of the PDA mass efficiency index increases as the soil flexibility increases, on the contrary, it decreases as the non-dimensional lateral stiffness ratio of the building increases; therefore, there is a significant increase of the vibration control effectiveness of PDAs for lateral flexural-type deformations on soft soils.