Background: Immune checkpoint inhibitors (ICI) have demonstrated success in solid tumors. In gynecologic cancers (GC), the response rate is still low (~10-15%) except in MSI-H endometrial cancer (~ 50%). Current biomarkers (e.g. PDL1 expression) have limited utility in identifying benefit from ICI in GC. In this work we evaluated the ability of computational measurements of spatial arrangement of tumor infiltrating lymphocytes (TIL) from H&E slide images in predicting overall survival (OS) and response to ICI in ovarian, cervical and endometrial cancers. Methods: The study included 151 patients, including 102 ovarian carcinomas treated with surgery and chemotherapy (D1) and another set (D2) of n=49 patients (n=14 ovarian, n=27 endometrial and n=8 cervical), treated with different ICI agents (Pembrolizumab, Nivolumab, Ipilimumab, Avelumab) in the second line setting. Progressors and non-progressors in D2 were classified according to clinical improvement and radiologic assessment by RECIST. A machine learning approach was employed to identify tumor regions on the diagnostic slides from D1 and D2 and then used to automatically identify TILs within the tumor regions. Subsequently machine learning was used to define TIL clusters based on TIL proximity, and graph network theory was used to capture measurements relating to spatial arrangement of TIL clusters. The multivariable Cox regression model (MCRM) was trained on n=51 patients from D1 to predict OS and then independently evaluated in predicting (1) OS on the hold-out n=51 patients in D1 and (2) response and progression-free survival (PFS) in D2. Results: Statistical analysis identified 7 prognostic features relating to interaction of TIL clusters with cancer nuclei. MCRM was prognostic of OS on the n=51 hold out patients in D1 (hazard ratio (HR)=2.06, 95% confidence interval [1.04- 4.07], p=0.008) and predictive of PFS in D2 (HR=2.24, CI=[1.13-4.44], p=0.03). The AUC for MCRM in predicting progression in D2 was 82%. Conclusions: Computerized features of spatial arrangement of TILs on H&E images were prognostic of OS and PFS and predicted response to ICI in three gynecological cancers. These findings need to be validated in larger, multi-site validation sets.