While he has a tight relationship with Ben Affleck, Matt Damon's wife ... had started getting recognized and asked for pictures and autographs, and then it got kind of aggressive because people ...