Optimizing ExifTool Performance

462 views
Skip to first unread message

Jeff Harmon

unread,
Dec 23, 2010, 6:21:58 PM12/23/10
to ResourceSpace
I was curious whether or not we were following best practices with
ExifTool?

http://owl.phy.queensu.ca/~phil/exiftool/#performance

http://www.christian-etter.de/?p=458

It seems there are marked differences in performance related to the
structuring of commands. Anyone closed to the code who can comment?

-Jeff

Jeff Harmon

unread,
Dec 27, 2010, 7:03:37 PM12/27/10
to ResourceSpace
I see that some users reported 60x speed improvements using some
methods. Wow, could any of these approaches make a huge difference
for us?

- Jeff

Daniel Westerling

unread,
Jan 2, 2011, 7:31:42 PM1/2/11
to resour...@googlegroups.com
Any news on this? :)

Tom Gleason

unread,
Jan 2, 2011, 7:45:00 PM1/2/11
to resour...@googlegroups.com

Exiftool is in no way a bottleneck for RS. Also I don't think any of these ideas would apply since we don't mass process metadata.

On Jan 2, 2011 7:31 PM, "Daniel Westerling" <Dan...@b-rudar.se> wrote:
> Any news on this? :)
>
> --
> You received this message because you are subscribed to the Google Groups "ResourceSpace" group.
> To post to this group, send email to resour...@googlegroups.com.
> To unsubscribe from this group, send email to resourcespac...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/resourcespace?hl=en.
>

Jeff Harmon

unread,
Jan 3, 2011, 6:09:42 AM1/3/11
to ResourceSpace
I don't understand your reply, Tom. Can you explain what's on your
mind more?

-Jeff

On Jan 2, 4:45 pm, Tom Gleason <theorysav...@gmail.com> wrote:
> Exiftool is in no way a bottleneck for RS. Also I don't think any of these
> ideas would apply since we don't mass process metadata.
> On Jan 2, 2011 7:31 PM, "Daniel Westerling" <Dan...@b-rudar.se> wrote:> Any news on this? :)
>
> > --
> > You received this message because you are subscribed to the Google Groups
>
> "ResourceSpace" group.> To post to this group, send email to resour...@googlegroups.com.
> > To unsubscribe from this group, send email to
>
> resourcespac...@googlegroups.com<resourcespace%2Bunsu...@googlegroups.com>
> .> For more options, visit this group at
>
> http://groups.google.com/group/resourcespace?hl=en.
>
>

Tom Gleason

unread,
Jan 3, 2011, 8:25:12 AM1/3/11
to resour...@googlegroups.com
Exiftool is the fastest part of the download process. It runs almost
instantaneously.
The batch methods wouldn't apply since all resources have different metadata.

> To unsubscribe from this group, send email to resourcespac...@googlegroups.com.


> For more options, visit this group at http://groups.google.com/group/resourcespace?hl=en.
>
>

--
Tom Gleason, PHP Developer
DBA Impressive Design

Exploring ResourceSpace at:
http://resourcespace.blogspot.com

Jeff Harmon

unread,
Jan 3, 2011, 3:19:39 PM1/3/11
to ResourceSpace
thx. what about process management?

"Also, the -execute option may be used to perform multiple independent
operations with a single invocation of exiftool, and together with the
-stay_open option provides a method for calling applications to avoid
this startup overhead."

a lot of a little adds up...

- J

On Jan 3, 5:25 am, Tom Gleason <theorysav...@gmail.com> wrote:
> Exiftool is the fastest part of the download process. It runs almost
> instantaneously.
> The batch methods wouldn't apply since all resources have different metadata.
>
>
>
> On Mon, Jan 3, 2011 at 6:09 AM, Jeff Harmon <jeffreyhhar...@gmail.com> wrote:
> > I don't understand your reply, Tom.  Can you explain what's on your
> > mind more?
>
> > -Jeff
>
> > On Jan 2, 4:45 pm, Tom Gleason <theorysav...@gmail.com> wrote:
> >> Exiftool is in no way a bottleneck for RS. Also I don't think any of these
> >> ideas would apply since we don't mass process metadata.
> >> On Jan 2, 2011 7:31 PM, "Daniel Westerling" <Dan...@b-rudar.se> wrote:> Any news on this? :)
>
> >> > --
> >> > You received this message because you are subscribed to the Google Groups
>
> >> "ResourceSpace" group.> To post to this group, send email to resour...@googlegroups.com.
> >> > To unsubscribe from this group, send email to
>
> >> resourcespac...@googlegroups.com<resourcespace%2Bunsu...@googlegroups.com>
> >> .> For more options, visit this group at
>
> >>http://groups.google.com/group/resourcespace?hl=en.
>
> > --
> > You received this message because you are subscribed to the Google Groups "ResourceSpace" group.
> > To post to this group, send email to resour...@googlegroups.com.
> > To unsubscribe from this group, send email to resourcespac...@googlegroups.com.
> > For more options, visit this group athttp://groups.google.com/group/resourcespace?hl=en.

Jeff Harmon

unread,
Jan 3, 2011, 3:22:44 PM1/3/11
to ResourceSpace
"disable... the print conversions (-n) if these features aren't
required"

since we provide the field names, i presume omitting the print
conversions might be ok?

- J

Tom Gleason

unread,
Jan 3, 2011, 3:31:00 PM1/3/11
to resour...@googlegroups.com
The point is that exiftool never takes more than a second to read or
write metadata...previewing, copying,transferring files all eclipse
this.

When looking to do optimization, we should focus on actual
bottlenecks. Exiftool isn't one at all.

> For more options, visit this group at http://groups.google.com/group/resourcespace?hl=en.

Jeff Harmon

unread,
Jan 3, 2011, 5:12:35 PM1/3/11
to ResourceSpace
maybe we'll circle back to this sometime later. thanks, tom.

- J
Reply all
Reply to author
Forward
0 new messages