You could do this with a post build event. Set the files to no action on compile, then in the macro copy the files to the directory you want.
Here’s a post build Macro that I think will work by copying all files in a directory called Configuration to the root build folder:
copy $(ProjectDir)Configuration\* $(ProjectDir)$(OutDir)