Empty WH_CALLWNDPROC hook crashes program right after WM_WINDOWPOSCHANGING message

This is a discussion on Empty WH_CALLWNDPROC hook crashes program right after WM_WINDOWPOSCHANGING message within the Windows Programming forums, part of the Platform Specific Boards category; Hi, I'm trying to hook into firefox.exe to capture a few messages. Which seems to work fine (messages are received), ...

  1. #1
    Registered User
    Join Date
    Oct 2007
    Location
    Norway
    Posts
    16

    Empty WH_CALLWNDPROC hook crashes program right after WM_WINDOWPOSCHANGING message

    Hi,

    I'm trying to hook into firefox.exe to capture a few messages. Which seems to work fine (messages are received), however when I give the window focus (by clicking on it in the task bar) Firefox crashes. It always happens right after the hook receives the WM_WINDOWPOSCHANGING message.

    My DLL code is:
    Code:
    FIREFOXDLL_API LRESULT GetMsgProc(
      int code,
      WPARAM wParam,
      LPARAM lParam
    )
    {
      return CallNextHookEx(0, code, wParam, lParam);
    }
    I've previously had some file writing code here, to output the message data, which is how I know it always crashes after the WM_WINDOWPOSCHANGING message.

    The main program has the following function:
    Code:
    // Called using EnumWindows(enumMainWindows, processID);
    // hkprcSysMsg and hinstDLL are correctly initialized
    BOOL CALLBACK enumMainWindows(HWND hwnd, LPARAM lParam)
    {
      DWORD pid;
      GetWindowThreadProcessId(hwnd, &pid);
      if (pid == lParam)
      {
        DWORD tid = GetWindowThreadProcessId(hwnd, NULL);
        SetWindowsHookEx( 
                              WH_CALLWNDPROC,
                              hkprcSysMsg,
                              hinstDLL,
                              tid); 
        return false;
      }
      return true;
    }
    If anyone could share any insight they might have regarding what can be causing this, it would be much appreciated.

  2. #2
    Banned
    Join Date
    Aug 2010
    Location
    Ontario Canada
    Posts
    9,547
    Quote Originally Posted by Waterbottle View Post
    Hi,

    I'm trying to hook into firefox.exe to capture a few messages. Which seems to work fine (messages are received), however when I give the window focus (by clicking on it in the task bar) Firefox crashes. It always happens right after the hook receives the WM_WINDOWPOSCHANGING message.

    My DLL code is:
    Code:
    FIREFOXDLL_API LRESULT GetMsgProc(
      int code,
      WPARAM wParam,
      LPARAM lParam
    )
    {
      return CallNextHookEx(0, code, wParam, lParam);
    }
    I've previously had some file writing code here, to output the message data, which is how I know it always crashes after the WM_WINDOWPOSCHANGING message.

    The main program has the following function:
    Code:
    // Called using EnumWindows(enumMainWindows, processID);
    // hkprcSysMsg and hinstDLL are correctly initialized
    BOOL CALLBACK enumMainWindows(HWND hwnd, LPARAM lParam)
    {
      DWORD pid;
      GetWindowThreadProcessId(hwnd, &pid);
      if (pid == lParam)
      {
        DWORD tid = GetWindowThreadProcessId(hwnd, NULL);
        SetWindowsHookEx( 
                              WH_CALLWNDPROC,
                              hkprcSysMsg,
                              hinstDLL,
                              tid); 
        return false;
      }
      return true;
    }
    If anyone could share any insight they might have regarding what can be causing this, it would be much appreciated.
    Did you try moving your enumMainWindows function into the DLL itself...
    From SetWindowsHookEx function (Windows)

    Quote Originally Posted by MSDN
    The global hooks are a shared resource, and installing one affects all applications in the same desktop as the calling thread. All global hook functions must be in libraries. Global hooks should be restricted to special-purpose applications or to use as a development aid during application debugging. Libraries that no longer need a hook should remove its hook procedure.

  3. #3
    Registered User
    Join Date
    Oct 2007
    Location
    Norway
    Posts
    16
    Thank you for responding. I tried that now, same problem. Maybe I need to call the DLL function some other way? Sorry for my ignorance, not very familiar with the Windows API, or DLLs.

    .EXE:
    Code:
    typedef int (__cdecl *MYPROC)(HINSTANCE); 
    
    static MYPROC  hkprcSysMsg;
    
      hkprcSysMsg = (MYPROC)GetProcAddress(hinstDLL, "?mainfunc@@YAHPAUHINSTANCE__@@@Z"); 
      if (!hkprcSysMsg)
        return 2;
    
      (hkprcSysMsg)(hinstDLL);
    DLL:
    Code:
    HINSTANCE self;
    
    FIREFOXDLL_API int mainfunc(HINSTANCE inst)
    {
      self = inst;
      int id = MYPROCESSID;
      EnumWindows(enumMainWindows, id);
      return 0;
    }
    
    FIREFOXDLL_API BOOL CALLBACK enumMainWindows(HWND hwnd, LPARAM lParam)
    {
      DWORD pid;
      GetWindowThreadProcessId(hwnd, &pid);
      if (pid == lParam)
      {
        DWORD tid = GetWindowThreadProcessId(hwnd, NULL);
        SetWindowsHookEx( 
                              WH_CALLWNDPROC,
                              (HOOKPROC)GetMsgProc,
                              self,
                              tid); 
        return false;
      }
      return true;
    }
    
    FIREFOXDLL_API LRESULT GetMsgProc(
      int code,
      WPARAM wParam,
      LPARAM lParam
    )
    {
      return CallNextHookEx(0, code, wParam, lParam);
    }
    Last edited by Waterbottle; 09-14-2011 at 02:43 AM.

  4. #4
    'Allo, 'Allo, Allo
    Join Date
    Apr 2008
    Posts
    612
    Quote Originally Posted by Waterbottle View Post
    Code:
        SetWindowsHookEx( 
                              WH_CALLWNDPROC,
                              (HOOKPROC)GetMsgProc,
                              self,
                              tid);
    Compilers chew you out for bad code for a reason, that cast is the equivalent of putting your hands over your ears and going "la la la, I'm not listening." This code is bad GetMsgProc has the wrong calling convention attributed to it. Like the enumMainWindows function, there needs to a CALLBACK inserted between the return type and the name of a function to fix it.

    The standard rule is, if you have to cast a function pointer, the code is broken.
    Last edited by adeyblue; 09-14-2011 at 04:52 AM.

  5. #5
    Banned
    Join Date
    Aug 2010
    Location
    Ontario Canada
    Posts
    9,547
    I don't know how much help this will be but this is a complete live DLL with a hook in it...
    It sends you a windows message when an application starts or stops and allows you to retrieve the window handle and filename of a newly launched application.


    Helper.c
    Code:
    #include "Helper.h"
    
    
    /////////////////////////////////////////////////////////////////
    // Shared data segment
    
    #pragma data_seg("Hook")
    HINSTANCE   hdll    = NULL;               // dll handle
    HWND        HWind   = NULL;               // handle of RMServer window
    HHOOK       RMHook  = NULL;               // message hook handle
    LAUNCHINFO  LInfo   = {0};                // info about program launch
    #pragma data_seg()
    #pragma comment(linker,"/SECTION:Hook,S")
    
    /////////////////////////////////////////////////////////////////////////////////////////
    // Export
    //
    
    // return launch info to server
    MMAPI VOID HelperGetInfo(pLAUNCHINFO Info)
      { memcpy(Info,&LInfo,sizeof(LInfo)); }
    
    
    
    /////////////////////////////////////////////////////////////////////////////////////////
    // gather information
    //
    
    // get information about launched program
    VOID HookGetInfo(HWND wParm)
      { TCHAR   cmdl[MAX_PATH] = {0};   // command line
        TCHAR   pgm[MAX_PATH] = {0};    // program name
        PTCHAR  args;                   // arguments
        // purge old data
        memset(&LInfo,0,sizeof(LAUNCHINFO));
        // set program window handle
        LInfo.Handle = wParm;    
        // get program info
        GetModuleFileName(NULL,pgm,MAX_PATH);
        _wsplitpath(pgm,NULL,NULL,LInfo.Name,LInfo.Ext);
        // get launched file info
        wcsncpy(cmdl,GetCommandLine(),MAX_PATH);
        args = PathGetArgs(cmdl);
        if(wcslen(args) < 1)
          return;
        args = wcsrchr(args,L'.');
        if (args)
          { wcscpy(LInfo.Type,args);
            // fix trailing quote
            args = wcsrchr(LInfo.Type,L'\"');
            if (args)
              *args = 0; } }
    
    
    
    /////////////////////////////////////////////////////////////////////////////////////////
    // Handle Shell Hook 
    //
    
    // hook tosser
    MMAPI LRESULT CALLBACK AppCatcher(INT Code, WPARAM wParm, LPARAM lParm)
      { switch (Code)
          { case HSHELL_WINDOWCREATED   :         // new window
              // gather launch info
              HookGetInfo((HWND) wParm);
              // send message to RMServer, wparam = Handle               
              PostMessage(HWind,UM_HELPERRUN,wParm,0); 
              break;
            case HSHELL_WINDOWDESTROYED :         // window closing
              // send messate to RMServer
              PostMessage(HWind,UM_HELPEREXIT,wParm,0);
              break; }
        return CallNextHookEx(RMHook,Code,wParm,lParm); } 
    
    
    
    /////////////////////////////////////////////////////////////////
    // Set the shell hook
    // Returns hook status 1 = active, 0 = not
    //
    
    // apply the hook to launched programs
    MMAPI BOOL WINAPI SetHook(HWND hWind)
      { HWind = hWind;   // handle of window to receive message
        RMHook = SetWindowsHookEx(WH_SHELL,&AppCatcher,hdll,0);
        return (RMHook != NULL); }      
    
    
    
    // remove the hook from launched programs
    MMAPI BOOL WINAPI FreeHook(void)
      { return UnhookWindowsHookEx(RMHook); }
    
    
    
    /////////////////////////////////////////////////////////////////
    //  DLL entry point
    //
    BOOL APIENTRY DllMain(HINSTANCE hinst, DWORD reason, LPVOID reserved)
      { if (reason == DLL_PROCESS_ATTACH)  // save instance handle
              hdll = hinst;
        return 1; }
    the helper.h file...
    Code:
    #ifndef HELPER_H
    #define HELPER_H
    
    // for the compiler
    #define UNICODE
    #define _UNICODE
    #define WIN32_LEAN_AND_MEAN
    #define _WIN32_WINNT 0x0502
    #define _X86_
    
    // project global headers
    #include <shlwapi.h>
    #include <wchar.h>
    
    #pragma lib "Helper.lib"
    
    #define MMAPI __declspec(dllexport)
    
    // messages sent by helper dll
    #define UM_HELPERRUN  WM_APP + 444
    #define UM_HELPEREXIT WM_APP + 445 
    
    // launch information
    #pragma pack(1)
    typedef struct tLAUNCHINFO
      { TCHAR Name[MAX_PROGRAMNAME]; // short program name
        TCHAR Ext[MAX_TYPENAME];     // program type
        TCHAR Type[MAX_TYPENAME];    // file type
        HWND  Handle; }              // program window handle  
      LAUNCHINFO, *pLAUNCHINFO;
    #pragma pack()
    
    
    
    // retrieve the command line
    MMAPI VOID HelperGetInfo(pLAUNCHINFO Info);
    
    // set the hook
    MMAPI BOOL WINAPI SetHook(HWND hWind);
    
    // release the hook
    MMAPI BOOL WINAPI FreeHook(void);
    
    
    #endif // HELPER_H

Popular pages Recent additions subscribe to a feed

Similar Threads

  1. Replies: 2
    Last Post: 03-26-2008, 05:44 PM
  2. Win32, Hook Functions, Message Pump...
    By Mastadex in forum C++ Programming
    Replies: 5
    Last Post: 02-02-2006, 11:19 AM
  3. My I/O Program crashes, I need some help
    By Guti14 in forum C Programming
    Replies: 4
    Last Post: 09-24-2004, 02:16 AM
  4. program output is empty!!!
    By ayesha in forum C++ Programming
    Replies: 4
    Last Post: 10-15-2001, 11:42 PM

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21