I finally found the name that describes what I wanted to know if agents could do back in 2010!!!!  My original question was:

I was wondering: if multiple cooperative agent teams are competing, could they learn when it would be in their best interest to cooperate with a competitor.

Now I know I was really wondering if learning agents could learn coopetition!!!

I always love to find the right terminology.  It makes life so much easier when doing research.