Drew Short
|
18ee94a9f2
|
Likelihood of over 1.6 million images for comparison in a personal library is likely rare. Improved performance of the thumbnail system by avoiding creating an overwhelming number of sub directories within sub directories to artifically handle a billion billion billion billion billion possbile md5 combinations. There just aren't that many files so it's a waste to presume non-even distribution of md5's such that it would break a filesystem requiring such limiting of directories for storage.
|
11 years ago |
Drew Short
|
0edd1d95d4
|
Fix for the thumbnail generation routine
|
11 years ago |
Drew Short
|
3c0401fd96
|
Overriding the archaic ehcache shipped with hibernate.
|
11 years ago |
Drew Short
|
04d7d6afe8
|
Removed 3 more debugging statements that are pointeless as the results are recorded elsewhere and they just introduce noise in the logs
|
11 years ago |
Drew Short
|
dc643512b7
|
Commented out a bunch of debug logging statements that aren't needed right now. Updated some hibernate config files. Added some exceptions to the logback config to ignore debug statements from hibernate and EHCache as they aren't important in our debugging right now. Updated todo... sort of...
|
11 years ago |
Drew Short
|
4503ccac99
|
Fixed issues with the persistence engine not being able to retrieve already processed images.
|
11 years ago |
Drew Short
|
dfa6de258c
|
Fixed an issue with persisting an Image and ImageHashDTO. Still encountering issues with "Nested Transactions Not Supported" when looking up images. Could be concurrent related, but likely the transactions aren't being closed properly on lookups, or the like.
|
11 years ago |
Drew Short
|
0d71dbe334
|
First commit with working H2 database and Hibernate configuration\! Persistance here we come\!\!\!
|
11 years ago |
Drew Short
|
0fcad44e4e
|
Started work on database integration. Cleaned up caching of thumbnails and improved performance of the thumb path method.
|
11 years ago |
Drew Short
|
929eb4ca3d
|
Partial fix for nulls during thumbnail caching.
|
11 years ago |
Drew Short
|
3a8ff629a0
|
Added thumbnail generation and added the cache folder to the ignore list
|
11 years ago |
Drew Short
|
d30c5ce24b
|
Removed the old default properties files now that we are using the new ones. (Application.conf)
|
11 years ago |
Drew Short
|
abdb1af77f
|
Moved logging primarily over to the typesafe:config system which uses JSON style nested configs. Also fixed some logging issues.
|
11 years ago |
Drew Short
|
8500f0559a
|
Changed over to logback from log4j. Added new minimum logging configurations. Remove log4j configurations and references.
|
11 years ago |
Drew Short
|
2850c3bf86
|
Fixes to NPE errors when searching directories recursively
|
11 years ago |
Drew Short
|
47606ba4a0
|
Added a recursive option. Added some information and changed the api of the Engine class.
|
11 years ago |
Drew Short
|
d474b42952
|
Massive improvements in the concurrent engine
|
11 years ago |
Drew Short
|
1520136d15
|
Making the sequential engine similarity searchthe default for the concurrent engine while solving the concurrent engine issues.
|
11 years ago |
Drew Short
|
912348c2f1
|
version changes, logging, todo
|
11 years ago |
Drew Short
|
d561199300
|
Added some logic to limit the number of heavy threads produced and used by the concurrent engine.
|
11 years ago |
Drew Short
|
b05634e002
|
Concurrency added for the get similar images method. Not convinced it is any faster and my be worse than the synchronous version.
|
11 years ago |
Drew Short
|
e7f0239c3f
|
Added some concurency properties to prevent the build failing on a meager build server.
|
11 years ago |
Drew Short
|
b36e1e55d2
|
Started work on making the images similarity search concurrent as well
|
11 years ago |
Drew Short
|
13ab46b5a8
|
Updated logging during searching to be less annoying. Changed the concurrent engine to use more actors, additionally made it use a different type of router for efficiency since not all images in a directory will take the same amount of time to process.
|
11 years ago |
Drew Short
|
19cd92850d
|
Working concurrent engine, however only a few methods are truly concurrent. Needs further work.
|
11 years ago |
Drew Short
|
4581de443e
|
Started work on making the processing of images concurrent on a per engine basis
|
11 years ago |
Drew Short
|
61d419d00c
|
Fixed the Akka dependencies
|
11 years ago |
Drew Short
|
fb11e0cd03
|
Added the Akka library for concurrency support
|
11 years ago |
Drew Short
|
784dec8313
|
AppCLI changes. Moving onto looking into threading the search and processing
|
11 years ago |
Drew Short
|
17688dcb17
|
Added some additional logging at the INFO level. Fixed the default Log4J.properties file to only output INFO and above to the console.
|
11 years ago |
Drew Short
|
5e0877dd4f
|
Fixed a cache usage issue and a logging issue
|
11 years ago |
Drew Short
|
2d46d862f0
|
Worked on getting caching in the engine. Worked on the CLI a little bit
|
11 years ago |
Drew Short
|
8b65937c76
|
Changes for memory amount during tests. This is starting to get a little annoying
|
11 years ago |
Drew Short
|
2e4672f391
|
Should be the final commit to the get the build environment working
|
11 years ago |
Drew Short
|
b311d819b9
|
Another tweak to allow the build to process on a low end build machine
|
11 years ago |
Drew Short
|
91d2fa3b92
|
Another tweak to allow the build to process on a low end build machine
|
11 years ago |
Drew Short
|
e7eb18568a
|
Fixed some test parameters
|
11 years ago |
Drew Short
|
f22be07b80
|
Added the first round of caching, added some compile time settings, modified the start scripts.
|
11 years ago |
Drew Short
|
df31c800d5
|
Added a controll to the commandline. Tweaked a few other portions of the code. Need to fix that part where everything is printed to the console when running AppCLI
|
11 years ago |
Drew Short
|
2de7c85c10
|
Added a getSimilarImagesForDirectory method
|
11 years ago |
Drew Short
|
e7a971ce2e
|
Added a similarImages class, updated some hashing methods
|
11 years ago |
Drew Short
|
dd0bccc81e
|
Added MD5 hashing to HashService and ImageHashDTO. Added tests against MD5 hashes. Added library for digests and hashing. Added Engine and test against Engine
|
11 years ago |
Drew Short
|
0fad91bf4e
|
Added RELEASE tag script and updated documentation
|
11 years ago |
Drew Short
|
74c70e0ecc
|
Updated some version code, and added a commons-cli dependancy
|
11 years ago |
Drew Short
|
a49f84ff14
|
Generated a bunch of scripts for managing releases.
|
11 years ago |
Drew Short
|
90fec0b0b5
|
Merge branch 'master' of https://github.com/warricksothr/ImageTools
|
11 years ago |
Drew Short
|
8579f4663a
|
Changes to the build scripts, added a script to increase patch version, tag and then build a release.
|
11 years ago |
Drew Short
|
9c775c2676
|
Added a script to fix the javafx classpath for nix* machines
|
11 years ago |
Drew Short
|
060aec7099
|
Added a development document
|
11 years ago |
Drew Short
|
cf2e951c43
|
Added some proper hashing. Added a few more tests. Added a little bit more benchmarking
|
11 years ago |