Switching from alpine:edge to :latest makes the thing actually build.
Lightweight ready-to use OpenCV image
$ docker run --rm -it -v $(pwd):/source schickling/opencv
$ g++ $(pkg-config --cflags --libs opencv) my-file.cpp