I am very hesitant to use or rely on PA due to horrible latency and frankly the whole concept of having a sound server where only mic input and speaker output are required sounds outlandish to me.
As soon as paths or library names differ, you will have to use scoped declarations. Otherwise it really does not matter. Win32 also links correctly using -lSomeCoolLib, therefor you could just use one LIBS directive.