_SCREENPRINT text$ Question

[Pete]

QB64 has a some very good mouse handling capabilities. I usually like to mix y inkey and mouse routines together, something like this bare bones example.

Code: QB64: [Select]

1. mydemo% = -1
2. DO
3.     _LIMIT 30
4.     b$ = INKEY$
5.     IF LEN(b$) THEN
6.         SELECT CASE LEN(b$)
7.             CASE 1
8.                 SELECT CASE b$
9.                     CASE CHR$(27): EXIT DO
10.                     CASE ELSE
11.                         IF mydemo% THEN mydemo% = 1: CALL mroutine(drag, double_click_lt, mydemo%)
12.                 END SELECT
13.             CASE 2
14.                 SELECT CASE RIGHT$(b$, 1)
15.                     CASE ELSE
16.                         IF mydemo% THEN mydemo% = 2: CALL mroutine(drag, double_click_lt, mydemo%)
17.                 END SELECT
18.         END SELECT
19.     ELSE
20.         CALL mroutine(drag, double_click_lt, mydemo%)
21.     END IF
22. LOOP
23. END
24.  
25. SUB mroutine (drag, double_click_lt, mydemo%)
26.     STATIC z1, lclick, bactive, oldmx, oldmy
27.  
28.     IF mydemo% > 0 THEN GOSUB mydemo: EXIT SUB
29.  
30.     IF lclick THEN
31.         IF TIMER < z1 THEN z1 = z1 - 86400 ' Midnight adjustment.
32.         IF TIMER - z1 > .33 THEN lclick = 0
33.     END IF
34.  
35.     WHILE _MOUSEINPUT
36.         mw = mw + _MOUSEWHEEL
37.     WEND
38.  
39.     mx = _MOUSEX
40.     my = _MOUSEY
41.     lb = _MOUSEBUTTON(1)
42.     rb = _MOUSEBUTTON(2)
43.     mb = _MOUSEBUTTON(3)
44.  
45.     IF bactive THEN
46.         SELECT CASE bactive
47.             CASE -1
48.                 IF lb = 0 THEN
49.                     SELECT CASE lclick
50.                         CASE 0
51.                             IF mydemo% THEN mydemo% = 3: GOSUB mydemo
52.                             lclick = lclick + 1
53.                         CASE ELSE ' Double click. Completed upon 2nd left button release.
54.                             IF mydemo% THEN mydemo% = 11: GOSUB mydemo
55.                             double_click_lt = -1
56.                             lclick = 0
57.                     END SELECT
58.                     bactive = 0
59.                     IF drag THEN drag = 0
60.                 ELSE
61.                     IF mx <> oldmx OR my <> oldmy THEN
62.                         IF mydemo% THEN mydemo% = 12: GOSUB mydemo
63.                         drag = -1
64.                     END IF
65.                 END IF
66.             CASE -2
67.                 IF rb = 0 THEN
68.                     IF mydemo% THEN mydemo% = 4: GOSUB mydemo
69.                     bactive = 0
70.                 END IF
71.             CASE -3
72.                 IF mb = 0 THEN
73.                     IF mydemo% THEN mydemo% = 5: GOSUB mydemo
74.                     bactive = 0
75.                 END IF
76.         END SELECT
77.     ELSE
78.         IF lb THEN
79.             IF mydemo% THEN mydemo% = 6: GOSUB mydemo
80.             bactive = -1
81.             z1 = TIMER
82.         ELSEIF rb THEN
83.             IF mydemo% THEN mydemo% = 7: GOSUB mydemo
84.             bactive = -2
85.         ELSEIF mb THEN
86.             IF mydemo% THEN mydemo% = 8: GOSUB mydemo
87.             bactive = -3
88.         ELSEIF mw THEN
89.             SELECT CASE mw
90.                 CASE IS > 0
91.                     IF mydemo% THEN mydemo% = 9: GOSUB mydemo
92.                 CASE IS < 0
93.                     IF mydemo% THEN mydemo% = 10: GOSUB mydemo
94.             END SELECT
95.         END IF
96.     END IF
97.     oldmx = mx: oldmy = my: mw = 0
98.     EXIT SUB
99.  
100.     mydemo:
101.     LOCATE 1, 1: PRINT "Last User Status:                                    ";
102.     LOCATE , 19
103.     SELECT CASE mydemo%
104.         CASE 1
105.             PRINT "1-byte keypress = "; b$
106.         CASE 2
107.             PRINT "2-byte keypress = "; b$
108.         CASE 3
109.             PRINT "Left button released."
110.         CASE 4
111.             PRINT "Right button released."
112.         CASE 5
113.             PRINT "Middle button released."
114.         CASE 6
115.             PRINT "Left button down."
116.         CASE 7
117.             PRINT "Right button down."
118.         CASE 8
119.             PRINT "Middle button down."
120.         CASE 9
121.             PRINT "Wheel scroll down."
122.         CASE 10
123.             PRINT "Wheel scroll up."
124.         CASE 11
125.             PRINT "Left button double click."
126.         CASE 12
127.             PRINT "Drag..."
128.     END SELECT
129.     mydemo% = -1
130.     RETURN
131. END SUB

I used a short sound to represent a left button double-click. All other mouse and wheel demos, including drag are printed to the screen. It is important to determine if your mouse routines will take effect upon button down or button release, and modify the code as needed for those specific circumstances.

As far as advice for SENDKEYS, just this. Remember that we can't easily get feedback for the automated key presses, and Windows loves to interrupt our routines with its many background processes, so don't expect short delays to always be sufficient Once an automated key press is missed, because the prior press wasn't processed quickly enough, the routine will fail.

Pete

EDIT: Changed it from a GOSUB to a SUB routine and improved the messaging display. Also, corrected + to - for midnight adjustment, darn aging process. Modified double click to register after the second left button press is released, instead of upon the second left button being pressed. This just makes it easier to display the double click message, without it being over-written with the left button release message. If I work on this more, I may make a user variable to designate any mouse action to act when button is down or act when the depressed button is released.

[luke]

CTRL + ^ is one.
CTRL + [, and CTRL + ] are two more, I think.
CTRL +? as well...
_ and \  for the others?

But I don't remember the order now, off the top of my head.

No need to remember them, the character and the control character always differ by 64 on the ASCII chart (on old terminals, the Control key would just force a bit to 0).

Well, you have to lookup the characters on the ASCII table but we have one in the IDE.

[Richard]

@Pete

I have been getting some more practice with your SENDKeys stuff (so far so good) - and now trying to expand into MOUSE stuff.

I have hit a problem with "focusing the mouse to an app".

In the program below what I have attempted to do was

- PROGRAM WINDOW  mouse around for 10 seconds
- switch over to NotePad
- for 10 seconds attempt to mouse around in NotePad
- finally let SENDKEYS do its magic

So far my problem is that I cannot get mouse co-ordinates in NotePad

Code: QB64: [Select]

1. redim shared z&,s&
2. redim shared title$
3. redim shared hwnd%&
4. dim shared color_t~&&,color_m~&&
5. DECLARE DYNAMIC LIBRARY "user32"
6.     SUB      SENDKEYS             ALIAS keybd_event (BYVAL bVk AS LONG, BYVAL bScan AS LONG, BYVAL dwFlags AS LONG, BYVAL dwExtraInfo AS LONG)
7.     FUNCTION FindWindowA%&        (BYVAL ClassName AS _OFFSET, WindowName$) 'find process handle by title
8.     FUNCTION SetForegroundWindow& (BYVAL hwnd AS _OFFSET) 'set foreground window process(focus)
9. END DECLARE
10.  
11. CONST KEYEVENTF_KEYUP = &H2
12. CONST VK_SHIFT =        &H10 'Shift key
13. CONST VK_CTRL =         &H11 ' Ctrl key
14. CONST VK_ALT =          &H12 ' Alt key
15.  
16. NotePad:
17. DEFLNG A-Z
18. SCREEN _NEWIMAGE(640, 480, 32)
19. _title "PROGRAM WINDOW":color &hffffff00~&&:locate 3,30:PRINT "This is PROGRAM WINDOW..."; : _DELAY 5
20. color &hff00ff00~&&:locate 10,1:print "MOUSE around PROGRAM WINDOW for 10 seconds"
21. color_t~&&=&hff00ff00~&&:color_m~&&=&hfffff000~&& :MouseAround
22.  
23. _delay 2:_screenclick 100,100: _delay .5
24. title$=  "START NotePad.exe"                                                                            '*******************
25. SHELL _DONTWAIT title$ 'opens Notepad file NOT MAXIMIZED
26. _delay 2
27. s = _SCREENIMAGE
28. _SOURCE s
29.  
30. focusApp 'Focused on NotePad
31. color &hffffffff~&&:play "L16N60"
32. cls:locate 3,30:print "switch mouse focus to NotePad" :timerold = timer
33. color &hff00ffff~&&:locate 10,1:print "MOUSE around PROGRAM WINDOW for 10 seconds"
34. color_t~&&=&hff00ffff~&&:color_m~&&=&hffff0000~&& :MouseAround
35.  
36. _SCREENPRINT "HELLO WORLD":
37. SLEEP 2:_SCREENPRINT CHR$(8) + CHR$(8) + CHR$(8) + CHR$(8) + CHR$(8) 'backspace 5 characters
38. SLEEP 3:_SCREENPRINT "QB64!"
39. SLEEP 2:for i%=1 to 10:gosub Ctrl_Plus:next ' MAXIMUM NLARGEMENT of NotePad
40. _SCREENPRINT CHR$(1) 'CTRL + A select all
41. SLEEP 2:_SCREENPRINT CHR$(3) 'CTRL + C copy to clipboard
42. SLEEP 2:PRINT _CLIPBOARD$
43. _CLIPBOARD$ = "QB64 ROCKS!"''SLEEP 2
44. _delay 2:_SCREENPRINT CHR$(22) 'CTRL + V paste from clipboard
45. _delay 9:
46. system
47. END
48.  
49. Ctrl_Plus:
50. SENDKEYS VK_CTRL, 0, 0, 0 ' Ctrl
51. SENDKEYS &HBB, 0, 0, 0 ' +
52. SENDKEYS &HBB, 0, KEYEVENTF_KEYUP, 0 ' Release +
53. SENDKEYS VK_CTRL, 0, KEYEVENTF_KEYUP, 0 ' Release Ctrl
54. _delay .2                                                                            '********************
55. return
56.  
57. SUB focusapp
58. hwnd%& = FindWindowA(0, title$ + CHR$(0))
59. _DELAY .1
60. z& = SetForegroundWindow&(hwnd%&)
61. _DELAY .1
62. END SUB
63.  
64. SUB MouseAround
65. timerold&=timer
66. do
67.     do while _mouseinput
68.         mx=_mousex:my = _mousey:c&=point(mx,my)
69.         locate 10,1:print space$(79);:locate 10,1:print _mousex;"x";_mousey;"y    ";hex$(c&)
70.     loop
71.     color color_t~&&:locate 10,75:print using "###";timerold+10-timer:color color_m~&&
72. loop until timer > timerold& +10
73. END SUB
74.  

[Pete]

Since you are no longer opening Notepad in full screen, you are having a problem focusing Notepad. The _SCREENCLICK needs to be placed at line 35.

color_t~&&=&hff00ffff~&&:color_m~&&=&hffff0000~&& :MouseAround
 _DELAY 2:_SCREENCLICK 100,100: _DELAY .5
_SCREENPRINT "HELLO WORLD":

Also, 100, 100 is only going to work if you have notepad open in the top left corner. That means you have to open Notepad manually, move it there, and close it.

I'd go with a Windows API focus by title. I believe "Untitled" is the Notepad default title. Provided there is only one copy of Notepad open, that should work. It's been at least two years since I've made a focus routine for Firefox, so I do not recall the code.

As for the mouse in QB64 finding coordinates in notepad, I do not believe that is conventionally possible. Notepad is not a QB64 program. For an unconventional approach, I suppose you could overlay a QB64 window, make it transparent, and measure the  mouse coordinates that way. This is often handy to see where a _SCREENCLICK should be made.

Pete

[SpriggsySpriggs]

You can just use the SetFocus() Windows API function to set focus to the Notepad window and then do your typing. Much more dependable than relying on it being in a specific spot or what color it is. Also, you can use GetWindowRect() from Windows API to find the boundaries of the Notepad window. It will give the coordinates of each corner.

[Pete]

Thanks Indy, that's what I was getting at. Ah, here is a little screen mapper I put together a year or two ago...

Code: QB64: [Select]

1. DEFINT A-Z
2. $RESIZE:ON
3.  
4. CONST HWND_TOPMOST%& = -1
5. CONST SWP_NOSIZE%& = &H1
6. CONST SWP_NOMOVE%& = &H2
7. CONST SWP_SHOWWINDOW%& = &H40
8.  
9. DIM Hold AS POINTAPI
10. TYPE POINTAPI
11.     X_Pos AS LONG
12.     Y_Pos AS LONG
13. END TYPE
14.  
15. DECLARE DYNAMIC LIBRARY "user32"
16.     FUNCTION ShowWindow& (BYVAL hwnd AS _OFFSET, BYVAL nCmdShow AS LONG) 'maximize process
17.     FUNCTION GetForegroundWindow& 'find currently focused process handle
18.     FUNCTION SetForegroundWindow& (BYVAL hwnd AS _OFFSET) 'set foreground window process(focus)
19.     FUNCTION SetLayeredWindowAttributes& (BYVAL hwnd AS LONG, BYVAL crKey AS LONG, BYVAL bAlpha AS _UNSIGNED _BYTE, BYVAL dwFlags AS LONG)
20.     FUNCTION GetWindowLong& ALIAS "GetWindowLongA" (BYVAL hwnd AS LONG, BYVAL nIndex AS LONG)
21.     FUNCTION SetWindowLong& ALIAS "SetWindowLongA" (BYVAL hwnd AS LONG, BYVAL nIndex AS LONG, BYVAL dwNewLong AS LONG)
22.     FUNCTION SetWindowPos& (BYVAL hWnd AS LONG, BYVAL hWndInsertAfter AS _OFFSET, BYVAL X AS INTEGER, BYVAL Y AS INTEGER, BYVAL cx AS INTEGER, BYVAL cy AS INTEGER, BYVAL uFlags AS _OFFSET)
23.     FUNCTION GetAsyncKeyState% (BYVAL vkey AS LONG)
24.     FUNCTION SetCursorPos (BYVAL x AS LONG, BYVAL y AS LONG)
25.     FUNCTION GetCursorPos (lpPoint AS POINTAPI)
26. END DECLARE
27.  
28. _CLIPBOARD$ = "" ' Clear clipboard.
29.  
30. ' Needed for acquiring the hWnd of the window
31. DIM Myhwnd AS LONG ' Get hWnd value
32. _TITLE "Translucent window test"
33. Myhwnd = _WINDOWHANDLE
34. wdth = 300: hght = 400
35.  
36. ' Set screen
37. s& = _NEWIMAGE(wdth, hght, 32)
38. SCREEN s&
39. _DEST 0
40. _DELAY .1
41.  
42. _SCREENMOVE 800, 50
43. ' Main loop
44. Level = 175
45. SetWindowOpacity Myhwnd, Level
46. _DELAY .2
47.  
48. DIM logger$(100), logger2$(100)
49.  
50. DO
51.     _LIMIT 30
52.     msg = GetCursorPos(Hold)
53.     LOCATE 1, 1: PRINT "Col ="; Hold.X_Pos;: LOCATE 1, 11: PRINT "Row ="; Hold.Y_Pos; "   ";
54.     IF GetAsyncKeyState(1) THEN
55.         IF flag THEN
56.             cnt = cnt + 1
57.             BEEP
58.             logger$(cnt) = LTRIM$(STR$(Hold.X_Pos))
59.             logger2$(cnt) = LTRIM$(STR$(Hold.Y_Pos))
60.         ELSE
61.             flag = -1
62.         END IF
63.     END IF
64.     IF GetAsyncKeyState(&H1B) THEN
65.         EXIT DO 'ESC key exits loop and prints logged key presses
66.     END IF
67.     IF _RESIZE THEN
68.         IF oldimage& <> 0 THEN
69.             oldimage& = s&
70.             wdth = _RESIZEWIDTH: hght = _RESIZEHEIGHT
71.             IF hght < 100 OR wdth < 150 THEN
72.                 IF hght <= 100 THEN hght = 100
73.                 IF wdth <= 150 THEN wdth = 150
74.                 _RESIZE OFF
75.                 _DELAY .2
76.                 s& = _NEWIMAGE(wdth, hght, 32)
77.                 SCREEN s&
78.                 _DISPLAYORDER _SOFTWARE , _HARDWARE
79.                 _FREEIMAGE oldimage&
80.                 _RESIZE ON
81.             ELSE
82.                 s& = _NEWIMAGE(wdth, hght, 32)
83.                 SCREEN s&
84.                 _FREEIMAGE oldimage&
85.             END IF
86.             LOCATE 4, 1
87.             PRINT mystring$;
88.         ELSE
89.             oldimage& = s&
90.         END IF
91.     END IF
92.  
93.     b$ = INKEY$
94.     IF LEN(b$) THEN
95.         IF b$ = CHR$(27) THEN SYSTEM
96.         IF LEN(b$) = 2 THEN
97.             IF b$ = CHR$(0) + CHR$(59) AND Level < 255 THEN Level = Level + 1: SetWindowOpacity Myhwnd, Level
98.             IF b$ = CHR$(0) + CHR$(60) AND Level > 0 THEN Level = Level - 1: SetWindowOpacity Myhwnd, Level
99.             yy = CSRLIN: xx = POS(0): LOCATE 1, 1: PRINT "Press F1/F2 to change opacity"; Level;: LOCATE yy, xx
100.         ELSE
101.             PRINT b$;
102.             mystring$ = mystring$ + b$
103.         END IF
104.     END IF
105.     _DISPLAY
106. LOOP
107. FOR i = 0 TO cnt
108.     PRINT "_SCREENCLICK "; logger$(i); ", "; logger2$(i)
109. NEXT
110. END
111.  
112. SYSTEM
113. '====================================================================\
114. SUB SetWindowOpacity (hwnd AS LONG, Level)
115.     DIM Msg AS LONG
116.     CONST G = -20
117.     CONST LWA_ALPHA = &H2
118.     CONST WS_EX_LAYERED = &H80000
119.     Msg = GetWindowLong(hwnd, G)
120.     Msg = Msg OR WS_EX_LAYERED
121.     action = SetWindowLong(hwnd, G, Msg)
122.     action = SetLayeredWindowAttributes(hwnd, 0, Level, LWA_ALPHA)
123. END SUB
124.  

It makes a translucent window, which you can size over an app, and find the screenclick coordinates by mousing to the point, left clicking, and press esc when you have all the stuff mapped to see a list of the coordinates in the QB64 program window.

Pete

[SpriggsySpriggs]

Oops. Yep, can't use SetFocus. Wrong function. It's SetForegroundWindow. Yep.

[Pete]

I just found my FireFox set focus routine...

Code: QB64: [Select]

1. ct]
2.  
3.     DECLARE DYNAMIC LIBRARY "user32"
4.         FUNCTION FindWindowA%& (BYVAL ClassName AS _OFFSET, WindowName$) 'handle by title
5.         FUNCTION ShowWindow& (BYVAL hwnd AS _OFFSET, BYVAL nCmdShow AS LONG) 'maximize process
6.         FUNCTION SetForegroundWindow& (BYVAL hwnd AS _OFFSET) 'set foreground window process(focus)
7.         FUNCTION GetForegroundWindow%& 'find currently focused process handle
8.     END DECLARE
9.      
10.     _SCREENMOVE 300, 200
11.     title$ = "hwnd Finder"
12.     _TITLE title$
13.     find$ = "Bing - mozilla firefox" ' Works but you need active window displayed.
14.     findqb$ = title$
15.     SHELL _HIDE "firefox.exe bing.com"
16.     _DELAY 5
17.     GOSUB focus
18.     PRINT "Make Firefox window size and press any key to minimize."
19.     PRINT "It will restore in 5 sec."
20.     SLEEP
21.     x& = ShowWindow&(hwnd%&, 2)
22.     _DELAY 5
23.     ' 0 closes app. 1 restores app. 2 minimizes app. 3 maximizes app.
24.     y& = ShowWindow&(hwnd%&, 1)
25.     _DELAY .1
26.     GOSUB focus
27.     PRINT "Press any key to Maximize Firefox."
28.     SLEEP
29.     y& = ShowWindow&(hwnd%&, 3)
30.     _DELAY .1
31.     GOSUB focus
32.     PRINT "Press any key to Close Firefox."
33.     SLEEP
34.     y& = ShowWindow&(hwnd%&, 0)
35.     END
36.      
37.     focus:
38.     hwnd%& = FindWindowA(0, findqb$ + CHR$(0))
39.     _DELAY .1
40.     FGwin%& = GetForegroundWindow%& 'get current process in focus
41.     _DELAY .1
42.     IF FGwin%& <> hwnd%& THEN z& = SetForegroundWindow&(hwnd%&) 'set focus when necessary
43.     _DELAY .1
44.     hwnd%& = FindWindowA(0, find$ + CHR$(0))
45.     _DELAY .1
46.     RETURN

[Richard]

@Pete

Just tried out simple changes (have not read/studied replies from @Pete @SpriggsySpriggs yet)

Tried the TRANSPARENT window effect ( i.e. without out the screen mode color at end  so have SCREEN NEWIMAGE(640,480).

This defaults to a SCREEN 0 (more correctly a TEXT SCREEN) - that's OK just means that color 0-31 only and co-ords as per character cell positions (not display pixels).


The TRANSPARENT window is 3200 x 1800 pixels (my native display resolution) and I on purpose offset down to _SCREENMOVE 10,110  (NOTHING to go in top 100 pixel scan rows). When NotePad comes into action - SOMETIMES it is on TOP else underneath the BLACK TRANSPARENT window where I can not see it. Manually I preset NotePad to 0,100 so I always know where the extreme Top Left Hand Corner of NotePad is.  In my way of thinking TRANSPARENT here is more of place a blackboard here instead (Transparent I myself think of simultaneously seeing all the layers underneath).

Apart from a "very jerky sluggish" mouse response (like say 1000 times slower) and maybe updates every 3 seconds or so (which would probably be still OK in my program automation (I wont be at the keyboard most of the time) - I notice that on the 50% of times when NotePad is on TOP that it seems that I have to move the mouse outside of the NotePad region (causing NotePad to go on bottom) and then having the "BLACKBOARD" (TRANSPARENT WINDOW) only I can mouse arround (very slowly).

Thanks for the tip on this unconventional approach.

Just wondering - any way (eg by setting alpha values for all 3200x1800 pixels) that I can change the "BLACKBOARD" to "plain cellophane" as the TRANSPARENT window.

So the above appears somewhat "potentially useable" for me - will try to refine further.  Then to "digest" info from your replies above.

[Richard]

@Pete @SpriggsySpriggs

My program at this stage (subject to change by your advice from above)

Code: QB64: [Select]

1. redim shared z&,s&
2. redim shared title$
3. redim shared hwnd%&
4.  
5. DECLARE DYNAMIC LIBRARY "user32"
6.     SUB      SENDKEYS             ALIAS keybd_event (BYVAL bVk AS LONG, BYVAL bScan AS LONG, BYVAL dwFlags AS LONG, BYVAL dwExtraInfo AS LONG)
7.     FUNCTION FindWindowA%&        (BYVAL ClassName AS _OFFSET, WindowName$) 'find process handle by title
8.     FUNCTION SetForegroundWindow& (BYVAL hwnd AS _OFFSET) 'set foreground window process(focus)
9. END DECLARE
10.  
11. CONST KEYEVENTF_KEYUP = &H2
12. CONST VK_SHIFT =        &H10 'Shift key
13. CONST VK_CTRL =         &H11 ' Ctrl key
14. CONST VK_ALT =          &H12 ' Alt key
15.  
16. NotePad:
17. DEFLNG A-Z
18. SCREEN _NEWIMAGE(640, 480)', 32)by ommiting screen modes --> TRANSPARENT
19. _screenmove 10,110 ' attempt to make PROGRAM WINDOW transparent
20. _title "PROGRAM WINDOW":
21. color 14:locate 3,30:PRINT "This is PROGRAM WINDOW...";
22. color 10:locate 5,1:print "MOUSE around PROGRAM WINDOW for 10 seconds"
23. _delay 2
24. MouseAround
25. _delay 3
26. title$=  "START NotePad.exe"                                                                            '*******************
27. SHELL _DONTWAIT title$ 'opens Notepad file NOT MAXIMIZED
28. _delay 2
29. s = _SCREENIMAGE
30. _SOURCE s
31.  
32. focusApp 'Focused on NotePad
33. play "L16N60":cls
34. color 31:locate 3,30:print "switch mouse focus to NotePad" :timerold = timer
35. color 14:locate 5,1:print "MOUSE around PROGRAM WINDOW for 20 seconds"
36. _delay 2
37. MouseAround
38. _delay 2:_screenclick 300,300: _delay .5
39. _SCREENPRINT "HELLO WORLD":
40. SLEEP 2:_SCREENPRINT CHR$(8) + CHR$(8) + CHR$(8) + CHR$(8) + CHR$(8) 'backspace 5 characters
41. SLEEP 3:_SCREENPRINT "QB64!"
42. SLEEP 2:for i%=1 to 10:gosub Ctrl_Plus:next ' MAXIMUM NLARGEMENT of NotePad
43. _SCREENPRINT CHR$(1) 'CTRL + A select all
44. SLEEP 2:_SCREENPRINT CHR$(3) 'CTRL + C copy to clipboard
45. SLEEP 2:PRINT _CLIPBOARD$
46. _CLIPBOARD$ = "QB64 ROCKS!"''SLEEP 2
47. _delay 2:_SCREENPRINT CHR$(22) 'CTRL + V paste from clipboard
48. _delay 9:
49. system
50. END
51.  
52. Ctrl_Plus:
53. SENDKEYS VK_CTRL, 0, 0, 0 ' Ctrl
54. SENDKEYS &HBB, 0, 0, 0 ' +
55. SENDKEYS &HBB, 0, KEYEVENTF_KEYUP, 0 ' Release +
56. SENDKEYS VK_CTRL, 0, KEYEVENTF_KEYUP, 0 ' Release Ctrl
57. _delay .2                                                                            '********************
58. return
59.  
60. SUB focusapp
61. hwnd%& = FindWindowA(0, title$ + CHR$(0))
62. _DELAY .1
63. z& = SetForegroundWindow&(hwnd%&)
64. _DELAY .1
65. END SUB
66.  
67. SUB MouseAround
68. timerold&=timer
69. do
70.     do while _mouseinput
71.         mx=_mousex:my = _mousey:locate 5,4:print space$(70);
72.         locate 5,5:print _mousex;"x";_mousey;"y    "
73.     loop
74.     color 26:locate 5,1:print using "###";timerold+20-timer:color 15
75. loop until timer > (timerold& +20)
76. END SUB
77.  

[Pete]

Try this demo to see how focus to an Untitled Notepad is done.

Code: QB64: [Select]

1. DECLARE DYNAMIC LIBRARY "user32"
2.     FUNCTION FindWindowA%& (BYVAL ClassName AS _OFFSET, WindowName$) 'handle by title
3.     FUNCTION ShowWindow& (BYVAL hwnd AS _OFFSET, BYVAL nCmdShow AS LONG) 'maximize process
4.     FUNCTION SetForegroundWindow& (BYVAL hwnd AS _OFFSET) 'set foreground window process(focus)
5.     FUNCTION GetForegroundWindow%& 'find currently focused process handle
6. END DECLARE
7.  
8. _SCREENMOVE 0, 0
9. title$ = "myprog"
10. _TITLE (title$)
11.  
12. SHELL _DONTWAIT "notepad"
13. _DELAY 4
14.  
15. DO
16.     title$ = "myprog"
17.  
18.     PRINT "Any key to focus on Notepad": GOSUB focus
19.  
20.     SLEEP
21.  
22.     title$ = "Untitled - Notepad"
23.  
24.     PRINT "Click here to focus on QB64.": GOSUB focus
25.  
26.     DO
27.         _LIMIT 30
28.         WHILE _MOUSEINPUT: WEND
29.         IF _MOUSEBUTTON(1) THEN EXIT DO
30.     LOOP
31. LOOP
32.  
33. focus:
34. hwnd%& = FindWindowA(0, title$ + CHR$(0))
35. _DELAY .1
36. FGwin%& = GetForegroundWindow%& 'get current process in focus
37. _DELAY .1
38. IF FGwin%& <> hwnd%& THEN z& = SetForegroundWindow&(hwnd%&) 'set focus when necessary
39. _DELAY .1
40. hwnd%& = FindWindowA(0, find$ + CHR$(0))
41. _DELAY .1
42. RETURN
43.  

Note in the focus sub, I just changed the findqb$ variable from my Firefox routine to titles$, for simplicity. Also, when you use a Windows focus routine, you should lose the _SCREENCLICK statement.

Pete

[Pete]

@Richard Your routine crashed my system, twice. I rewrote it below. It's a s close as I could approximate to what it looked like you tried to achieve.

Code: QB64: [Select]

1. REDIM SHARED z&
2. REDIM SHARED title$
3. REDIM SHARED hwnd%&
4.  
5. DECLARE DYNAMIC LIBRARY "user32"
6.     SUB SENDKEYS ALIAS keybd_event (BYVAL bVk AS LONG, BYVAL bScan AS LONG, BYVAL dwFlags AS LONG, BYVAL dwExtraInfo AS LONG)
7.     FUNCTION FindWindowA%& (BYVAL ClassName AS _OFFSET, WindowName$) 'handle by title
8.     FUNCTION ShowWindow& (BYVAL hwnd AS _OFFSET, BYVAL nCmdShow AS LONG) 'maximize process
9.     FUNCTION SetForegroundWindow& (BYVAL hwnd AS _OFFSET) 'set foreground window process(focus)
10.     FUNCTION GetForegroundWindow%& 'find currently focused process handle
11. END DECLARE
12.  
13. CONST KEYEVENTF_KEYUP = &H2
14. CONST VK_SHIFT = &H10 'Shift key
15. CONST VK_CTRL = &H11 ' Ctrl key
16. CONST VK_ALT = &H12 ' Alt key
17.  
18. NotePad:
19. DEFLNG A-Z
20. SCREEN _NEWIMAGE(640, 480, 32)
21. _SCREENMOVE 10, 110
22. _DELAY .2
23. _TITLE "PROGRAM WINDOW"
24. _DELAY .1
25. s = _SCREENIMAGE
26. _SOURCE s
27.  
28. COLOR &HFF00FF00~&&
29. LOCATE 5, 1: PRINT "MOUSE around PROGRAM WINDOW for 10 seconds"
30. _DELAY 2
31.  
32. MouseAround
33. _DELAY 3
34.  
35. SHELL _HIDE _DONTWAIT "start Notepad" 'opens Notepad file NOT MAXIMIZED
36. _DELAY 2
37.  
38. PLAY "L16N60": CLS
39. LOCATE 3, 30: PRINT "switch mouse focus to NotePad": timerold = TIMER
40. LOCATE 5, 1: PRINT "MOUSE around PROGRAM WINDOW for 10 seconds"
41. _DELAY 2
42. MouseAround
43.  
44. _DELAY 1
45. title$ = "Untitled - Notepad": focusapp 'Focused on NotePad
46.  
47. _DELAY 1
48. _SCREENPRINT "HELLO WORLD":
49. SLEEP 2: _SCREENPRINT CHR$(8) + CHR$(8) + CHR$(8) + CHR$(8) + CHR$(8) 'backspace 5 characters
50. SLEEP 3: _SCREENPRINT "QB64!"
51. SLEEP 2: FOR i% = 1 TO 10: GOSUB Ctrl_Plus: NEXT ' MAXIMUM NLARGEMENT of NotePad
52. _SCREENPRINT CHR$(1) 'CTRL + A select all
53. SLEEP 2: _SCREENPRINT CHR$(3) 'CTRL + C copy to clipboard
54. SLEEP 2: PRINT _CLIPBOARD$
55. _CLIPBOARD$ = "QB64 ROCKS!" ''SLEEP 2
56. _DELAY 2: _SCREENPRINT CHR$(22) 'CTRL + V paste from clipboard
57. _DELAY 9:
58. SYSTEM
59. END
60.  
61. Ctrl_Plus:
62. SENDKEYS VK_CTRL, 0, 0, 0 ' Ctrl
63. SENDKEYS &HBB, 0, 0, 0 ' +
64. SENDKEYS &HBB, 0, KEYEVENTF_KEYUP, 0 ' Release +
65. SENDKEYS VK_CTRL, 0, KEYEVENTF_KEYUP, 0 ' Release Ctrl
66. _DELAY .2 '********************
67. RETURN
68.  
69. SUB focusapp
70.     hwnd%& = FindWindowA(0, title$ + CHR$(0))
71.     _DELAY .1
72.     FGwin%& = GetForegroundWindow%& 'get current process in focus
73.     _DELAY .1
74.     IF FGwin%& <> hwnd%& THEN z& = SetForegroundWindow&(hwnd%&) 'set focus when necessary
75.     _DELAY .1
76. END SUB
77.  
78. SUB MouseAround
79.     timerold& = TIMER
80.     LOCATE 5, 1: PRINT SPACE$(_WIDTH);
81.     DO
82.         _LIMIT 120
83.         WHILE _MOUSEINPUT: WEND
84.         mx = _MOUSEX: my = _MOUSEY
85.         LOCATE 5, 5: PRINT _MOUSEX; "x"; _MOUSEY; "y    "
86.         LOCATE 5, 1: PRINT USING "###"; timerold + 10 - TIMER
87.     LOOP UNTIL TIMER > (timerold& + 10)
88. END SUB

Pete

[SMcNeill]

If you guys use PowerShell, you can use Get-Location or Get-UiaWindow to get the exact coordinates for your notepad.exe on the screen. 

Code: [Select]

$test = Start-Process notepad.exe -PassThru | Get-UiaWindow #| Get-UiaCurrentPattern -PassThru

$test.Current.BoundingRectangle
https://docs.microsoft.com/en-us/powershell/module/microsoft.powershell.management/get-location?view=powershell-7.1

[Richard]

   

@Pete  - sorry to have crashed your computer twice! (I did not mean that to happen)


@Pete @SpriggsySpriggs @SMcNeill



Sorry - I think you are on a different "wavelength" from me - this may be because I have not explained myself very well and/or the example provided is not clear and detailed enough.


I think that @Pete saying that "NotePad is not a QB64 program" sums up the situation (and those words may echo in my mind for the next 25 years). I gather that because NotePad is not a program created by QB64, then now it cannot be truely focused on (I hope I am very wrong with this statement). So far, to date, SENDKEYS seems to be able to focus onto NotePad (i.e. via my QB64 program I can get to do some simple things such as Ctrl+ to enlarge the text) - rather than me being at the keyboard performing those same keystrokes.

If I may restate my program requirements (with a very silly example to hopefully clarify better).


Solely by virtue of my QB64 program alone (i.e. once launched I am not present at the keyboard)....



- open up a QB64 Program window (NOTHING ever to occupying the top 100 scan lines of display)

- for 10 seconds display mouse coordinates (if mouse cursor is over the program window - so if a cat played with the mouse during this time, it is reflected in displayed mouse movements)

- switch over to NotePad (idealy NOT MAXIMIZED - however if this cannot work I would allow it to be MAXIMIZED)

- for 10 seconds display mouse co-ordinates (if mouse cursor is over the non-maximized NotePad window) - i.e. now the co-ords displayed are only with regard to NotePad

- do some SENDKEYS magic ( Ctrl + ) to enlarge the NotePad text area - NOTHING ELSE (so therefore no changes to untitled.txt)

- if mouse is truely "focused" to NotePad - my QB64 program should be able to re-locate the mouse cursor to the Top Right Hand Corner of NotePad (which I would have established experimentally the co-ords of same before hand) and CLOSE NotePad (without me being at keyboard).




Assuming the above can be achieved, then eventually other things such as the color at a certain pixel of NotePad, actually write into NotePad the co-ords where the mouse cursor was at the time in NotePad (or better output to a separate file), minimize the NotePad window, etc could be done I hope.



@Pete regarding your demo program (although not doing the mouse thing as outlined above) - there were problems of no response after the first set of switching "focus" from Program window to NotePad Window. Also having _CLIPBOARD$ = "" made programs a bit more robust (in my case not displaying edits of my program onto the Program Window display).


With regards to the un-conventional TRANSPARENT window overlay (which I call a BLACKBOARD) - I discovered that I cannot even manually operate the mouse "click through" the BLACKBOARD to close NotePad (when NotePad is not on top) - so I do not have a potentially useable system as previously stated. So maybe all this TRANSPARENT stuff only relates to QB64 programs only ???



@SMcNeill    I have never used PowerShell before (have used QB64 SHELL cmd stuff tons of time) - could you provide QB64 code example how to use PowerShell please?

[Pete]

All this mouseing around crap is about just wanting to close Notepad????!!!!!!!!!!!!!!!!!!

ARHHHHHHHHHH!

WARNING: THIS KILL EVERY INSTANCE OF NOTEPAD OPEN ON YOUR COMPUTER WITHOUT PROMPTING YOU TO SAVE. IF YOU HAVE OTEHR INSTANCES OF UNSAVED NOTEPAD FILES ON YOUR DESKTOP, SAVE THEM AND CLOSE THEM BEFORE RUNNING THIS CODE.

Code: QB64: [Select]

1. SHELL _HIDE "taskkill /f /im notepad.exe"
2.  

That kills ALL Notepad opened. It forces them shut, even though writing to it would normally ask you if you wanted it saved.

Also, you can use sendkeys to send Alt+F then x then n. The n is for "Don't Save"

Pete :D