CN102253573A - Front projection device and front projection control method thereof - Google Patents

Front projection device and front projection control method thereof Download PDF

Info

Publication number
CN102253573A
CN102253573A CN2010101757468A CN201010175746A CN102253573A CN 102253573 A CN102253573 A CN 102253573A CN 2010101757468 A CN2010101757468 A CN 2010101757468A CN 201010175746 A CN201010175746 A CN 201010175746A CN 102253573 A CN102253573 A CN 102253573A
Authority
CN
China
Prior art keywords
gesture
user
mouse
front projection
slide
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2010101757468A
Other languages
Chinese (zh)
Inventor
陈建霖
王绍文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hongfujin Precision Industry Shenzhen Co Ltd
Hon Hai Precision Industry Co Ltd
Original Assignee
Hongfujin Precision Industry Shenzhen Co Ltd
Hon Hai Precision Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hongfujin Precision Industry Shenzhen Co Ltd, Hon Hai Precision Industry Co Ltd filed Critical Hongfujin Precision Industry Shenzhen Co Ltd
Priority to CN2010101757468A priority Critical patent/CN102253573A/en
Publication of CN102253573A publication Critical patent/CN102253573A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention provides a front projection control method which is applied to a front projection device. The device is connected to a camera. The method comprises the following steps of: setting three gestures, wherein each gesture corresponds to an operation key of a mouse; when an opened file is projected to a projection curtain, and receiving scene images of a file interpreted by a user of the camera; identifying whether the gesture of the user in the scene image is same as a set gesture or not; when the gesture identified in the scene image is the same as the set gesture, tracking the tip of an index finger of the user; and projecting a vernier at the tip of the index finger of the user, and executing the function of the operation key of the mouse corresponding to the set gesture according to the identified gesture. The invention further provides the front projection device. By the method and the device, the functions of various operation keys of the mouse can be simulated.

Description

Front projection apparatus and front projection control method thereof
Technical field
The present invention relates to a kind of front projection apparatus and front projection control method thereof.
Background technology
The interior spaces such as classroom, meeting-place, lecture hall, hall are the important places that people carry out collective activity, increase along with the interior space, projection arrangement becomes necessary tool gradually, think that student, participant, spectators etc. provide another piece " blackboard ", have remedied the defective that large space brings in a way.At present, the above-mentioned interior space mainly uses front projection apparatus to carry out projection, promptly, from the place ahead on projecting planes such as curtain with image projection on this projecting plane, traditional front projection apparatus need pass through the broadcast of mouse, keyboard or other input media control documents, for example, need establish the operation that a people is responsible for mouse, keyboard specially in addition.
Summary of the invention
In view of above content, be necessary to provide a kind of front projection apparatus, it can simulate the left-right key function of slide-mouse and the sliding function of roller, the broadcast of control documents by gesture.
In addition, also be necessary to provide a kind of front projection control method, it can simulate the left-right key function of slide-mouse and the sliding function of roller, the broadcast of control documents by gesture.
A kind of front projection apparatus, this device links to each other with video camera, and this device comprises:
Module is set, is used to be provided with the operating key of three gestures and the corresponding slide-mouse of each gesture;
Identification module is used for when the file of opening is projected onto on the projection screen, receive video camera and take the user and explain the scene image of file, and whether discern the gesture of user in this scene image identical with set gesture;
Tracing module is used for the forefinger tip that gesture when the above-mentioned gesture of discerning from scene image and setting is followed the trail of the user when identical; And
Execution module is used for the most advanced and sophisticated place's projection of the forefinger vernier the user, and carries out the function of the operating key of the corresponding slide-mouse of set gesture according to the gesture that recognizes.
A kind of front projection control method is applied in the front projection apparatus, and this device links to each other with video camera, and this method comprises the steps: to be provided with the operating key of three gestures and the corresponding slide-mouse of each gesture; When the file of opening is projected onto on the projection screen, receives video camera and take the scene image that the user explains file; Whether the gesture of discerning user in this scene image is identical with set gesture; When the gesture of the above-mentioned gesture of discerning from scene image and setting is identical, the forefinger tip of following the trail of the user; Reach the most advanced and sophisticated place's projection of forefinger vernier, and carry out the function of the operating key of the corresponding slide-mouse of set gesture according to the gesture that recognizes in the user.
Compared to prior art, described front projection apparatus and front projection control method thereof, can simulate the left-right key function of slide-mouse and the sliding function of roller by gesture, control documents carries out projection and plays, make the user both can give a lecture to the audience in the projection screen front, also need not to realize associative operation to file by other people cooperation, in addition, the application place of described front projection apparatus can be not restricted yet, no matter be the interior spaces such as classroom, lecture hall, concert hall, auditorium, still can provide open, the semi open model space in projection place all can use.
Description of drawings
Fig. 1 is the operation environment figure of the better embodiment of front projection apparatus of the present invention.
Fig. 2 is the functional block diagram of the better embodiment of gesture slide-mouse recognition unit among Fig. 1.
Fig. 3 is the operation process chart of front projection control method better embodiment of the present invention.
Fig. 4 is the function setting synoptic diagram of gesture slide-mouse of the present invention.
Fig. 5 to Fig. 9 is the function presentation figure of gesture slide-mouse of the present invention.
The main element symbol description
Front projection apparatus 1
Gesture slide-mouse recognition unit 10
Memory device 20
Processor 30
Projecting cell 40
Projection screen 2
Video camera 3
Module is set 100
Identification module 102
Tracing module 104
Execution module 106
Embodiment
As shown in Figure 1, be the operation environment figure of the better embodiment of front projection apparatus of the present invention.Described front projection apparatus 1 has a plurality of port (not shown)s, can be used for connecting electronic equipment or memory storage, and the file in this electronic equipment or the memory storage is projected on the projection screen 2.Described electronic equipment can be that (personal digital assistant, PDA) etc., described memory storage can be removable memory for computing machine, notebook computer, mobile phone or personal digital assistant.
In the present embodiment, there is a gesture slide-mouse recognition unit 10 in the described front projection apparatus 1, be used for sliding function, and control front projection apparatus 1 projection file in conjunction with video camera 3 captured scene images by left button, right button and the roller that gesture simulation slide-mouse is set.Concrete grammar as described in Figure 3.
As shown in Figure 2, be the functional block diagram of the gesture slide-mouse recognition unit better embodiment among Fig. 1.In this figure, except operation has gesture slide-mouse recognition unit 10, also comprise memory device 20, processor 30 and projecting cell 40 in the described front projection apparatus 1.
Wherein, memory device 20 is used to store the computerize program code of described gesture slide-mouse recognition unit 10.In other embodiments, this memory device 20 can be the external storer of front projection apparatus 1.
Processor 30 is carried out the computerize program code of described gesture slide-mouse recognition unit 10, promptly discern the gesture that whether has the user in the captured scene image of video camera 3, whether be the gesture slide-mouse that set in advance, and control the front projection operation of front projection apparatus 1 according to the detecting result if when having gesture, detecting this gesture.
The file that projecting cell 40 is used for opening projects to projection screen 2, and show that according to the gesture that detects corresponding operation information is on projection screen 2, as choosing menu etc. according to position, the demonstration of the gesture demonstration vernier that detects, concrete displaying contents such as Fig. 5 are to shown in Figure 9.
Described gesture slide-mouse recognition unit 10 comprises: module 100, identification module 102, tracing module 104 and execution module 106 are set.
Before identification user's gesture, the operating key that module 100 need be provided with a plurality of gestures and the corresponding slide-mouse of each gesture earlier is set.In the present embodiment, because these a plurality of gestures are the functions that are used to show slide-mouse, therefore, the quantity of gesture is three.As shown in Figure 4, this gesture comprises first gesture, second gesture and the 3rd gesture of the right hand, and wherein, first gesture is showed the slip page scrollbar functionality of slide-mouse roller, menu function is chosen in the unlatching of second gesture displaying slide-mouse right button, and the 3rd gesture is showed determining of slide-mouse left button and chosen function.Shown in Figure 4 only for illustrating, in other embodiments, these three gestures can also be configured to other gestures respectively.When the user opened 1 pair of file of front projection apparatus and carries out projection and play, video camera 3 can the photographed scene images, the image when promptly taking the user and explaining file.
Identification module 102 receives this scene image, discerns whether there is gesture in this scene image.In the present embodiment, discern the hand that whether exists gesture to be meant user in the identification scene image in the scene image and whether appear at before the projection screen 2 or on the projection screen 2.When recognition result when having gesture, whether user's gesture identical with set gesture in identification module 102 these scene images of identification.Particularly, the gesture that identification module 102 detecting users' finger is formed, and each gesture that the gesture that detects is set with module 100 is set compares, to determine that this gesture that detects is whether identical with a certain gesture in the set gesture, as whether only representing first gesture by forefinger, whether form second gesture, perhaps whether form the 3rd gesture by forefinger, middle finger, the third finger and little finger on hand of user by a forefinger and thumb on hand of user.
Described tracing module 104 is used for the gesture that recognizes when identification module 102 when identical with set gesture, the forefinger tip of following the trail of the user.
Described execution module 106 is used for according to the gesture that recognizes, and most advanced and sophisticated place carries out the operating function of slide-mouse correspondence in forefinger, thereby the front projection of front projection apparatus 1 is controlled, and particular content is consulted described in Fig. 3.
As shown in Figure 3, be the operation process chart of front projection control method better embodiment of the present invention.
Step S1, the file that projecting cell 40 in the startup front projection apparatus 1 will have been opened is projected on the projection screen 2, video camera 3 is taken the scene image that the user explains file, and sends this scene image to front projection apparatus 1, and identification module 102 receives this scene image.
Whether step S2 exists user's gesture in these scene images of identification module 102 identification, whether the hand of promptly discerning user in the scene image appears at before the projection screen 2 or on the projection screen 2, and judges whether the gesture that recognizes is identical with set gesture.If recognition result is for existing user's gesture in this scene image, the gesture of showing as user's the right hand, and this gesture is identical with set gesture, and then flow process enters step S3.If recognition result for the gesture that has the user in the gesture that do not have the user in this scene image or this scene image but this gesture that recognizes and set gesture not simultaneously, then direct process ends.
Step S3, identification module 102 compares by the gesture that will recognize and set gesture, to determine which kind of gesture is this gesture that recognizes be.If the gesture that recognizes is the forefinger that the user stretches out, show that then the gesture that recognizes is first gesture, flow process enters step S4; If the gesture that recognizes is forefinger, middle finger, the third finger and the little finger on hand that the user stretches out, show that then the gesture that recognizes is second gesture, flow process enters step S5; If the gesture that recognizes is a thumb and the forefinger on hand that the user stretches out, show that then the gesture that recognizes is the 3rd gesture, flow process enters step S6.
Step S4, the forefinger tip that tracing module 104 is followed the trail of the user, execution module 106 is according to the operating key that the pairing slide-mouse of first gesture that sets in advance in the module 100 is set, in the most advanced and sophisticated function of locating the projection vernier and carrying out roller of user's forefinger, as the page scroll bar that slides according to the upper and lower slip of forefinger in first gesture, as shown in Figure 6, execution module 106 goes out a white glove in the most advanced and sophisticated place's projection of user's right hand forefinger, and this white glove is vernier.In the present embodiment, the type of vernier can set in advance by module 100 is set.
Step S5, the forefinger tip that tracing module 104 is followed the trail of the user, execution module 106 is according to the operating key that the pairing slide-mouse of second gesture that sets in advance in the module 100 is set, in the most advanced and sophisticated function of locating the projection vernier and carrying out the slide-mouse right button of user's forefinger, choose menu as unlatching, as shown in Figure 8.
Step S6, the forefinger tip that tracing module 104 is followed the trail of the user, execution module 106 is according to the operating key that the pairing slide-mouse of the 3rd gesture that sets in advance in the module 100 is set, in the most advanced and sophisticated function of locating the projection vernier and carrying out the slide-mouse left button of user's forefinger, as determining and choosing function.As shown in Figure 5, execution module 106 is in user's the most advanced and sophisticated place's projection of forefinger vernier, and definite function of execution slide-mouse left button, promptly clicks the icon (as the little palm among Fig. 5) in " initiation gesture slide-mouse recognition system ".What Figure 9 shows that execution module 106 carries out slide-mouse in the vernier place chooses function (as choose " last " in the menu of Fig. 9).
In addition, identification module 102 in the present embodiment not only can be discerned the gesture of user's right hand, can also discern the gesture of user's left hand, that is to say, although actual hand of making gesture is different when the module 100 set that hands of making gesture being set explaining file with the user, as the set right hand that is of making gesture of module 100 is set, and user's actual left hand that is of making gesture when explaining file, can image identification module 102 identification gestures yet.In other embodiments, it is within the rule that there is defective (two forefingers being arranged as the user) in user's finger on physiology.
Utilize the front projection control method in the present embodiment also can realize: when user's hand leaves projection screen 2, as shown in Figure 7, vernier can be anchored in the place that the user removes hand, and perhaps when the user changed gesture, vernier can temporarily be anchored in the place before gesture changes.
Above embodiment is only unrestricted in order to technical scheme of the present invention to be described, although the present invention is had been described in detail with reference to above better embodiment, those of ordinary skill in the art should be appreciated that and can make amendment or be equal to the spirit and scope that replacement should not break away from technical solution of the present invention technical scheme of the present invention.

Claims (9)

1. front projection apparatus, this device links to each other with video camera, it is characterized in that this device comprises:
Module is set, is used to be provided with the operating key of three gestures and the corresponding slide-mouse of each gesture;
Identification module is used for when the file of opening is projected onto on the projection screen, receive video camera and take the user and explain the scene image of file, and whether discern the gesture of user in this scene image identical with set gesture;
Tracing module is used for the forefinger tip that gesture when the above-mentioned gesture of discerning from scene image and setting is followed the trail of the user when identical; And
Execution module is used for the most advanced and sophisticated place's projection of the forefinger vernier the user, and carries out the function of the operating key of the corresponding slide-mouse of set gesture according to the gesture that recognizes.
2. front projection apparatus as claimed in claim 1, it is characterized in that, described gesture comprises first gesture, second gesture and the 3rd gesture, this first gesture is meant that the user stretches out forefinger, second gesture refers to that use person stretches out forefinger, middle finger, the third finger and a little finger on hand, and the 3rd gesture refers to that the user stretches out a forefinger and a thumb on hand.
3. front projection apparatus as claimed in claim 2, it is characterized in that, described operating key comprises roller, left button and the right button of slide-mouse, described first gesture is carried out the function of the slip page scroll bar of slide-mouse roller, the function of menu is chosen in the unlatching of second gesture execution slide-mouse right button, and the 3rd gesture is carried out determining of slide-mouse left button or chosen function.
4. front projection apparatus as claimed in claim 1 is characterized in that, the type of described vernier sets in advance by module is set.
5. a front projection control method is applied in the front projection apparatus, and this device links to each other with video camera, it is characterized in that this method comprises the steps:
The operating key of the corresponding slide-mouse of three gestures and each gesture is set;
When the file of opening is projected onto on the projection screen, receives video camera and take the scene image that the user explains file;
Whether the gesture of discerning user in this scene image is identical with set gesture;
When the gesture of the above-mentioned gesture of discerning from scene image and setting is identical, the forefinger tip of following the trail of the user; And
The projection vernier is located at forefinger tip in the user, and carries out the function of the operating key of the corresponding slide-mouse of set gesture according to the gesture that recognizes.
6. front projection control method as claimed in claim 5, it is characterized in that, described gesture comprises first gesture, second gesture and the 3rd gesture, this first gesture is meant that the user stretches out forefinger, second gesture refers to that use person stretches out forefinger, middle finger, the third finger and a little finger on hand, and the 3rd gesture refers to that the user stretches out a forefinger and a thumb on hand.
7. front projection control method as claimed in claim 6, it is characterized in that, described operating key comprises roller, left button and the right button of slide-mouse, described first gesture is carried out the function of the slip page scroll bar of slide-mouse roller, the function of menu is chosen in the unlatching of second gesture execution slide-mouse right button, and the 3rd gesture is carried out determining of slide-mouse left button or chosen function.
8. front projection control method as claimed in claim 5 is characterized in that the type of described vernier can set in advance.
9. front projection control method as claimed in claim 5 is characterized in that, before the step that whether user's gesture is identical with set gesture in this scene image of identification, this method also comprises step:
Discern the gesture that whether has the user in this scene image;
If exist, carry out the whether identical step of gesture of user in this scene image of above-mentioned identification with set gesture; And
If there is not process ends.
CN2010101757468A 2010-05-18 2010-05-18 Front projection device and front projection control method thereof Pending CN102253573A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010101757468A CN102253573A (en) 2010-05-18 2010-05-18 Front projection device and front projection control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010101757468A CN102253573A (en) 2010-05-18 2010-05-18 Front projection device and front projection control method thereof

Publications (1)

Publication Number Publication Date
CN102253573A true CN102253573A (en) 2011-11-23

Family

ID=44980913

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010101757468A Pending CN102253573A (en) 2010-05-18 2010-05-18 Front projection device and front projection control method thereof

Country Status (1)

Country Link
CN (1) CN102253573A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102780864A (en) * 2012-07-03 2012-11-14 深圳创维-Rgb电子有限公司 Projection menu-based television remote control method and device, and television
CN103324282A (en) * 2012-03-21 2013-09-25 卡西欧计算机株式会社 Input user interface device, projecting device and command deciding method
CN103559809A (en) * 2013-11-06 2014-02-05 常州文武信息科技有限公司 Computer-based on-site interaction demonstration system
CN103576846A (en) * 2012-08-09 2014-02-12 深圳市中兴移动通信有限公司 Wireless projection system
CN105278661A (en) * 2014-07-11 2016-01-27 胜华科技股份有限公司 Gesture control method with mouse tracking control and five-direction-key waving control
CN114489341A (en) * 2022-01-28 2022-05-13 北京地平线机器人技术研发有限公司 Gesture determination method and apparatus, electronic device and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5528263A (en) * 1994-06-15 1996-06-18 Daniel M. Platzker Interactive projected video image display system
CN1517779A (en) * 2003-01-21 2004-08-04 惠普开发有限公司 Interactive display equipment
CN101510121A (en) * 2009-03-12 2009-08-19 重庆大学 Interface roaming operation method and apparatus based on gesture identification
JP2010066971A (en) * 2008-09-10 2010-03-25 Nec Personal Products Co Ltd Information processor

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5528263A (en) * 1994-06-15 1996-06-18 Daniel M. Platzker Interactive projected video image display system
CN1517779A (en) * 2003-01-21 2004-08-04 惠普开发有限公司 Interactive display equipment
JP2010066971A (en) * 2008-09-10 2010-03-25 Nec Personal Products Co Ltd Information processor
CN101510121A (en) * 2009-03-12 2009-08-19 重庆大学 Interface roaming operation method and apparatus based on gesture identification

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324282A (en) * 2012-03-21 2013-09-25 卡西欧计算机株式会社 Input user interface device, projecting device and command deciding method
US9213411B2 (en) 2012-03-21 2015-12-15 Casio Computer Co., Ltd. Input user interface device, projecting device, command deciding method and program storage medium storing command deciding method program
CN103324282B (en) * 2012-03-21 2017-12-19 卡西欧计算机株式会社 Input user's interface device, projection arrangement, order determination method
CN102780864A (en) * 2012-07-03 2012-11-14 深圳创维-Rgb电子有限公司 Projection menu-based television remote control method and device, and television
CN102780864B (en) * 2012-07-03 2015-04-29 深圳创维-Rgb电子有限公司 Projection menu-based television remote control method and device, and television
CN103576846A (en) * 2012-08-09 2014-02-12 深圳市中兴移动通信有限公司 Wireless projection system
CN103559809A (en) * 2013-11-06 2014-02-05 常州文武信息科技有限公司 Computer-based on-site interaction demonstration system
CN103559809B (en) * 2013-11-06 2017-02-08 常州文武信息科技有限公司 Computer-based on-site interaction demonstration system
CN105278661A (en) * 2014-07-11 2016-01-27 胜华科技股份有限公司 Gesture control method with mouse tracking control and five-direction-key waving control
CN114489341A (en) * 2022-01-28 2022-05-13 北京地平线机器人技术研发有限公司 Gesture determination method and apparatus, electronic device and storage medium

Similar Documents

Publication Publication Date Title
US20140033040A1 (en) Portable device with capability for note taking while outputting content
KR20170080538A (en) Content displaying method based on smart desktop and smart desktop terminal thereof
US9761277B2 (en) Playback state control by position change detection
CN102253573A (en) Front projection device and front projection control method thereof
CN103176744B (en) A kind of display equipment and its information processing method
US8253690B2 (en) Electronic device, character input module and method for selecting characters thereof
TW201142465A (en) Front projection device and front projection controlling method
US9189152B2 (en) Touch device and method for dynamically setting touch inactive area, and non-transitory recording medium
CN102549532A (en) Electronic apparatus using touch panel and setting value modification method of same
WO2018113064A1 (en) Information display method, apparatus and terminal device
KR102125212B1 (en) Operating Method for Electronic Handwriting and Electronic Device supporting the same
CN108256071B (en) Method and device for generating screen recording file, terminal and storage medium
CN104077065A (en) Method for displaying virtual keyboard by touch screen terminal and touch screen terminal
CN104898880A (en) Control method and electronic equipment
CN103353826A (en) Display equipment and information processing method thereof
EP2746922A2 (en) Touch control method and handheld device utilizing the same
CN108475126A (en) The processing method and touch keyboard of touch operation
CN104461296B (en) A kind of method and device that mobile terminal is shared at PC ends
US20190114131A1 (en) Context based operation execution
US10084849B1 (en) System and method for providing and interacting with coordinated presentations
CN103853489A (en) Method and device for judging operation habits of user
CN112269481A (en) Method and device for controlling friction force adjustment and electronic equipment
US20170004725A1 (en) Method for implementing intelligent flash cards in mobile device having touch screen, and mobile device having touch screen for implementing intelligent flash cards
CN109683721A (en) A kind of input information display method and terminal
CN106020506A (en) Information input method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C05 Deemed withdrawal (patent law before 1993)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20111123