Drew Short
|
b9faa78f43
|
Started work on abstracting out the messaging in the engine. Moving over to dedicated actor(s) for handling messages and progress.
|
11 years ago |
Drew Short
|
18ee94a9f2
|
Likelihood of over 1.6 million images for comparison in a personal library is likely rare. Improved performance of the thumbnail system by avoiding creating an overwhelming number of sub directories within sub directories to artifically handle a billion billion billion billion billion possbile md5 combinations. There just aren't that many files so it's a waste to presume non-even distribution of md5's such that it would break a filesystem requiring such limiting of directories for storage.
|
11 years ago |
Drew Short
|
0edd1d95d4
|
Fix for the thumbnail generation routine
|
11 years ago |
Drew Short
|
04d7d6afe8
|
Removed 3 more debugging statements that are pointeless as the results are recorded elsewhere and they just introduce noise in the logs
|
11 years ago |
Drew Short
|
dc643512b7
|
Commented out a bunch of debug logging statements that aren't needed right now. Updated some hibernate config files. Added some exceptions to the logback config to ignore debug statements from hibernate and EHCache as they aren't important in our debugging right now. Updated todo... sort of...
|
11 years ago |
Drew Short
|
4503ccac99
|
Fixed issues with the persistence engine not being able to retrieve already processed images.
|
11 years ago |
Drew Short
|
0d71dbe334
|
First commit with working H2 database and Hibernate configuration\! Persistance here we come\!\!\!
|
11 years ago |
Drew Short
|
0fcad44e4e
|
Started work on database integration. Cleaned up caching of thumbnails and improved performance of the thumb path method.
|
11 years ago |
Drew Short
|
929eb4ca3d
|
Partial fix for nulls during thumbnail caching.
|
11 years ago |
Drew Short
|
3a8ff629a0
|
Added thumbnail generation and added the cache folder to the ignore list
|
11 years ago |
Drew Short
|
abdb1af77f
|
Moved logging primarily over to the typesafe:config system which uses JSON style nested configs. Also fixed some logging issues.
|
11 years ago |
Drew Short
|
8500f0559a
|
Changed over to logback from log4j. Added new minimum logging configurations. Remove log4j configurations and references.
|
11 years ago |
Drew Short
|
2850c3bf86
|
Fixes to NPE errors when searching directories recursively
|
11 years ago |
Drew Short
|
47606ba4a0
|
Added a recursive option. Added some information and changed the api of the Engine class.
|
11 years ago |
Drew Short
|
d474b42952
|
Massive improvements in the concurrent engine
|
11 years ago |
Drew Short
|
1520136d15
|
Making the sequential engine similarity searchthe default for the concurrent engine while solving the concurrent engine issues.
|
11 years ago |
Drew Short
|
d561199300
|
Added some logic to limit the number of heavy threads produced and used by the concurrent engine.
|
11 years ago |
Drew Short
|
b05634e002
|
Concurrency added for the get similar images method. Not convinced it is any faster and my be worse than the synchronous version.
|
11 years ago |
Drew Short
|
e7f0239c3f
|
Added some concurency properties to prevent the build failing on a meager build server.
|
11 years ago |
Drew Short
|
b36e1e55d2
|
Started work on making the images similarity search concurrent as well
|
11 years ago |
Drew Short
|
13ab46b5a8
|
Updated logging during searching to be less annoying. Changed the concurrent engine to use more actors, additionally made it use a different type of router for efficiency since not all images in a directory will take the same amount of time to process.
|
11 years ago |
Drew Short
|
19cd92850d
|
Working concurrent engine, however only a few methods are truly concurrent. Needs further work.
|
11 years ago |
Drew Short
|
4581de443e
|
Started work on making the processing of images concurrent on a per engine basis
|
11 years ago |
Drew Short
|
17688dcb17
|
Added some additional logging at the INFO level. Fixed the default Log4J.properties file to only output INFO and above to the console.
|
11 years ago |
Drew Short
|
5e0877dd4f
|
Fixed a cache usage issue and a logging issue
|
11 years ago |
Drew Short
|
2d46d862f0
|
Worked on getting caching in the engine. Worked on the CLI a little bit
|
11 years ago |
Drew Short
|
f22be07b80
|
Added the first round of caching, added some compile time settings, modified the start scripts.
|
11 years ago |
Drew Short
|
df31c800d5
|
Added a controll to the commandline. Tweaked a few other portions of the code. Need to fix that part where everything is printed to the console when running AppCLI
|
11 years ago |
Drew Short
|
2de7c85c10
|
Added a getSimilarImagesForDirectory method
|
11 years ago |
Drew Short
|
e7a971ce2e
|
Added a similarImages class, updated some hashing methods
|
11 years ago |
Drew Short
|
dd0bccc81e
|
Added MD5 hashing to HashService and ImageHashDTO. Added tests against MD5 hashes. Added library for digests and hashing. Added Engine and test against Engine
|
11 years ago |
Drew Short
|
74c70e0ecc
|
Updated some version code, and added a commons-cli dependancy
|
11 years ago |
Drew Short
|
8579f4663a
|
Changes to the build scripts, added a script to increase patch version, tag and then build a release.
|
11 years ago |
Drew Short
|
cf2e951c43
|
Added some proper hashing. Added a few more tests. Added a little bit more benchmarking
|
11 years ago |
Drew Short
|
8c9936a45d
|
Added mathematics library for transformation support. Implemented PHash and added PHash specific tests
|
11 years ago |
Drew Short
|
3ce5f16313
|
Fixed the hashing algorithm to use Longs and also added an AHash class
|
11 years ago |
Drew Short
|
cefb9d3f6a
|
Actually moved images, and fixed DHash method to be more consistent and pretty :)
|
11 years ago |
Drew Short
|
67aee43791
|
Moved samples out so they don't get packaged. Updated test location information. Commented out some debugging as it is a bit overboard now that the original issue is fixed. Modified the gitignore to avoid rolling log files.
|
11 years ago |
Drew Short
|
4e9c5cf87f
|
Fixed broken unit test. Added some properties and functions. Added a timing trait and benchmarking to DHash tests
|
11 years ago |
Drew Short
|
24a1b32bad
|
Started work on hashing and added a sample image for testing. First new unit test is broken due to array indexing issues. Configured the pom further for testing configuration. Added a few properties to support different levels or precision depending on the hash.
|
11 years ago |
Drew Short
|
b04be2e73b
|
Added image service to handle getting image data, converting image data, and special processing of image data. Also added some Logging mixin's to classes
|
11 years ago |
Drew Short
|
3869f2b302
|
Added a new enum class for know properties. Started fleshing out the HashService and how it will generate hashes. Added a hamming object to calculate hamming distances between two long values
|
11 years ago |
Drew Short
|
a4dcb4a4ad
|
changed from difference to compare
|
11 years ago |
Drew Short
|
b96df92cfd
|
Updated Version to support comparisons
|
11 years ago |
Drew Short
|
175a95d295
|
Started work on version comparison
|
11 years ago |
Drew Short
|
9d115841a6
|
Got parsing of property files to work. Fixed some annoyances. Added a version class to handle parsing versions from the properties file
|
11 years ago |
Drew Short
|
3699870198
|
Refactored App to use AppConfig for initial configuration. Updated ResourceLoader with logging. Added a default properties file, and a PropertiesService to load that properties file. Updated ImageHashDTO to include some fields. Added a HashService to manage generating hashes. moved the about file to an about.info file so we can automatically process it.
|
11 years ago |
Drew Short
|
32d9924a3a
|
Forgot to hand over the FXML loading to the new loader. Also, renamed the loader to be more descriptive of it's functionality.
|
11 years ago |
Drew Short
|
9c9c17ad5e
|
Implemented fixes that apply to resource loading in the JFX Jar. Should now be launchable, configure loggers correctly, and be able to load embedded files. Added a FileLoader helper class to manage loading resources. Is not thread safe currently, but should be made so.
|
11 years ago |
Drew Short
|
2ebdd39dfc
|
Started working on a rough Image class to handle storing and comparing images, along with hashing.
|
11 years ago |