Background: The role of primary care providers (PCPs) in caring for cancer survivors is critical, as care shifts from active cancer treatment to managing late and long-term effects of treatment and health maintenance. Safety net providers often need to provide cancer survivorship care in limited resource settings. This study assessed PCPs’ knowledge, attitudes, and self-efficacy related to caring for breast and colon cancer survivors in a public hospital setting. Methods: A modified National Cancer Institute Survey of Physician Attitudes Regarding the Care of Cancer Survivors was sent electronically to 220 PCPs in 12 primary care clinics in the San Francisco Health Network affiliated with Zuckerberg San Francisco General Hospital. The response rate was 50% (110/220). Results: About half of PCPs strongly/somewhat agreed (vs. strongly/somewhat disagreed) that PCPs have the knowledge needed to provide follow-up care related to breast (49%) and colon cancer (53%). Providers were more likely to report feeling somewhat/very confident (vs. not at all confident) in providing appropriate surveillance testing to detect recurrent colon than breast cancer (73.6% vs. 65.3%). Most providers (92%) correctly reported recommended frequency of mammography, however, frequency of blood tests and other imaging surveillance were not as well recognized for breast or colon cancer. Recognition of long-term side effects of chemotherapy drugs was low (highest = 44% for Adriamycin). Lack of knowledge (76.3%) and unclear delineation of roles between PCP and oncologists (70.7%) were the most commonly reported barriers to providing high quality cancer survivorship care. Only 33% of providers reported receiving any survivorship training on late and long-term effects of treatment. The most preferred model for survivorship care was shared care (40.2%) and least preferred was one in which PCPs have primary responsibility (47.6%). Conclusions: PCPs feel they lack the appropriate knowledge, training, and confidence to assume primary responsibility for the care of breast and colon cancer survivors. A shared care model was most preferred, indicating an opportunity to improve survivorship care through effective oncologist-PCP-patient partnerships.